-- Logs begin at Wed 2022-06-08 12:14:42 UTC, end at Wed 2022-06-08 13:23:14 UTC. -- Jun 08 12:44:21.930361 dv-cinder-836996-32-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 8 12:44:21 2022] *** Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: nodename: dv-cinder-836996-32-iscsi Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: machine: x86_64 Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: clock source: unix Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: pcre jit disabled Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: detected number of CPU cores: 4 Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: current working directory: / Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: detected binary path: /usr/bin/uwsgi-core Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: your processes number limit is 47680 Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: your memory page size is 4096 bytes Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: detected max file descriptor number: 2048 Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: lock engine: pthread robust mutexes Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: thunder lock: enabled Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 08 12:44:21.944985 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 08 12:44:21.986514 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: Python main interpreter initialized at 0x55a9817a19c0 Jun 08 12:44:21.986514 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: python threads support enabled Jun 08 12:44:21.986514 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: your server socket listen backlog is limited to 100 connections Jun 08 12:44:21.986514 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: your mercy for graceful operations on workers is 90 seconds Jun 08 12:44:21.986884 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: mapped 403077 bytes (393 KB) for 2 cores Jun 08 12:44:21.986955 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: *** Operational MODE: preforking *** Jun 08 12:44:21.987220 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: *** uWSGI is running in multiple interpreter mode *** Jun 08 12:44:21.987220 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: spawned uWSGI master process (pid: 80211) Jun 08 12:44:21.987422 dv-cinder-836996-32-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 08 12:44:21.993570 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: spawned uWSGI worker 1 (pid: 80223, cores: 1) Jun 08 12:44:21.993570 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: spawned uWSGI worker 2 (pid: 80224, cores: 1) Jun 08 12:44:21.993570 dv-cinder-836996-32-iscsi devstack@keystone.service[80211]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 08 12:44:27.833778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 12:44:27.833778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: from cryptography.utils import int_from_bytes Jun 08 12:44:27.834538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 12:44:27.834538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: from cryptography.utils import int_from_bytes Jun 08 12:44:27.834675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 12:44:27.834675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: from cryptography.utils import int_from_bytes Jun 08 12:44:27.835114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 12:44:27.835114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: from cryptography.utils import int_from_bytes Jun 08 12:44:27.889406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 12:44:27.889683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 12:44:27.889816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] command line args: [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 12:44:27.890094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 12:44:27.890275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ================================================================================ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 12:44:27.890535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] admin_token = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.890788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] config_dir = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.890980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.891166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] config_source = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.891350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] debug = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.891554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.892053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.892145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.892354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.892605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.892841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.893025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] log_config_append = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.893210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.893291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 12:44:27.893395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] log_dir = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.893478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 12:44:27.893613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] log_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.893703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] command line args: [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 12:44:27.893849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.894008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 12:44:27.894095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.894311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.894452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ================================================================================ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 12:44:27.894585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.894720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.894864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] admin_token = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.895001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.895207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] config_dir = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.895410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.895604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] config_source = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.895793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] debug = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.896004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.896177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.896261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.896423 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.896538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.896665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.896756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.896906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_config_append = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_dir = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897866 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.897943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.898081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.898864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.898995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.899180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.899299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.899418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.899514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] publish_errors = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.899629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.899762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.899855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.900938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] standard_threads = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901423 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] use_journal = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.901963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.902047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] use_json = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.902162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] use_stderr = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.902342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] use_syslog = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.902470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.902580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.902656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] publish_errors = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.902844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.902925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.903090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.903166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.903276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.903350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.903533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.903624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.903777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.903859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.904020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] standard_threads = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.904102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.904266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.904347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.904515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.904597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.904697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.904773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.904877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_journal = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.904999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.905085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_json = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.905223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_stderr = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.905298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.905403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_syslog = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.905479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.905678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 12:44:27.905765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.905944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.906021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.906190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.906266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.906441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.906523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.906684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.906761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.906944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.907025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.907189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.907266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.907434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.907520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.907677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.907799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.907936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.908015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.908192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.908298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.908450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.908537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.908694 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.908778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.908926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909246 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.909993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.910165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.910250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.910402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.910485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.910637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.910735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.910890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.910977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.911139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.911216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.911381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.911457 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.911679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.911758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.911937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.912059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.912179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.912421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.912506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.912664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.912752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.912905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.912983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.913163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.913248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.913399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.913482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.913664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.913744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.913943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.914971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.915125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.915237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.915348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.915442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.915596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.915696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.915827 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.915926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.916062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.916178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.916299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.916377 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.916522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.916637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.916759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.916835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.917001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.917089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.917258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.917336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.917504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.917615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.917793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.917967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.918950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.919996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.920148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.920239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.920402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.920532 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.920640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.920716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.920875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.920957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.921111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.921195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.921360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.921436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.921629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.921709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.921871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.921949 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.922115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.922191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.922355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.922429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.922593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.922669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.922833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.922916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.923074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.923150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.923320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.923396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.923587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.923662 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.923807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.923884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.924049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.924132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.924292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.924369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.924530 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.924611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.924767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.924853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.925982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.926065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.926222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.926309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.926456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.926545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.926702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.926778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.926942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.927018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.927195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.927279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.927437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.927514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.927676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.927751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.927921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.external = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.928946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.929112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.929188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.929351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.929477 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.password = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.929658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.token = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.929742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.929885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930479 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.930947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.931115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.931200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.931350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.931426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.external = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.931584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.931660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.931831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.931914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.932082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.932160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.932335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.932418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.password = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.932571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.token = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.932648 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.932816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.932892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.933057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.933141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.933325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.933408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.933582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.933664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.933829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.933915 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.934080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.934157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.934339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.934415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.934658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.934733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.934927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.935004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.935174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.935251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.935441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.935552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.935688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.935787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.935925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.936003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.936165 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.936241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.936445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.936522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.936681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.936759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.936933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.937011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.937176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.937260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.937435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.937512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.937701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.937780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.938925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.939003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.939175 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.939252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.939415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.939500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.939650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.939727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.939908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.940155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.940419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.940666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.940930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.941177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.941440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.941516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.941722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.941803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.941981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.942057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.942232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.942308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.942478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.942556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.942721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.942798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.942973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.943049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.943208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.943285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.943453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.943530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.943707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.943792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.943969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.944046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.944204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.944280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.944443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.944528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.944682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.944758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.944936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.945672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.945798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.945916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.946040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.946137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.946232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.946314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.946510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.946635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.946881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.947004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.947130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.947309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.947392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.947566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.947646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.947827 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.947905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.948063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.948140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.948308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.948387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.948559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.948637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.948806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.948883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.949058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.949136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.949300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.949377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.949535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.949632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.949804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.949884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.950043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.950121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.950287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.950365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.950532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.950616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.950782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.950861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.951987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.952065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.952225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.952302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.952465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.952541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.952720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.952798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.952962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.953039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.953195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.953271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.953433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.953512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.953691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.953770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.953940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954749 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.954990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.955157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.955234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.955394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.955472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.955633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.955712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.955874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.955958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.956117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.956209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.956361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.956440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.956600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.956677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.956837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.956923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.957080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.957159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.957323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.957400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.957590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.957684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.957827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.957905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.958061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.958138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.958315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.958401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.958559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.958637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.958806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.958883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.959045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.959129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.959286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.959370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.959536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.959612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.959784 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.959869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.960025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.960102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.960271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.960349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.960502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.960586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.961315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.961437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.961595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.961927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.962020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.962226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.962305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.962378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.963889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964482 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964553 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964694 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.964984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.965099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.965180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.965344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.965422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.965627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.965711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.965870 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] role.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.965948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.966124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] role.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.966201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.966387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.966475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.966605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.966684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.966848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] role.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.966926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.967099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.967176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] role.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.967333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.967410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.967589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.967668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.967839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.967923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.968089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.968165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.968338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.968414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.968583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.968662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.968830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.968907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.969081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.969168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.969329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.969413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.969610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.969692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.969864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.970053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.970133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.970295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.970373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.970551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.970628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.970806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.971021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.971098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.971265 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.971348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.971522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.971607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.971774 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.971852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.972981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.973067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.973237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.973315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.973473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.973596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.973744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.973836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] token.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.974950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.975999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.976159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.976273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.976454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.976562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.976695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.976774 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.976950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.977038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.977188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.977272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.977432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.977537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.977694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.977774 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.977944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.978996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.979171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.979248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.979407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.979493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.979656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.979735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.979910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.979988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.980159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.980236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.980399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.980485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.980642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.980727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.980884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.980967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.981125 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.981203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.981374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.981460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.981640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.981722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.981885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.981962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.982120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.982209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.982366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.982443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.982601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.982677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.982847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.982995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.983069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.983139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.983309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.983387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.983548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.983633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.983726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 12:44:27.983803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.984018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.984266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.984508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 12:44:27.984682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 12:44:28.013849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.014324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.015502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.015739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.015989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.022811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.025329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.051650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.051883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.053655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.053895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.108869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.110315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.159735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.159952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.160039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.160115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.228276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.228501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.228732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.228959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.229185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.229406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.229815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.230060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.230296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.230528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.230754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.230973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.253574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.253756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.253847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.253994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.254951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.255086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.266052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.266383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.279449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.279714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.279915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.280892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.281035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.281255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 12:44:28.298679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.298894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 12:44:28.299235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.299442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 12:44:28.299590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.299712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.299794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 12:44:28.299973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.300162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.300244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.300370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 12:44:28.300474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.300645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.300912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.301175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.301434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.311324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.311606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.311879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.312165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.312526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.312829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.313107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.313411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.320574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.321950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.323912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.324204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.324490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.324777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.325064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.325214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.325323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.325525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.325630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.325850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.325948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.326132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.326219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.326403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.326493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.326673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.326752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.326943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.327220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.327493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.327770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.328038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.354666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.356039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.356277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.356558 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.357687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.357974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.361998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.362232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.362511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.363439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.363724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.364011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.370044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.370334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.371862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.372154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.374816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.375109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.375389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.375670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.375945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.376220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.376490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.376674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.376867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.376948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.377237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.377524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.377828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.378106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.378380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.378764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.395365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.395655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.397404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.397738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.400754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.402970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.404520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.404822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.407260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.407561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.409941 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.412613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.413534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.416858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.417801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.418107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.418391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.418675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.418955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.419247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.420497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.420804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.421115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.421417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.421736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.422031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.441925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.442215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.442488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.442755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.444439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.444732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.445035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.445378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.450728 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.453410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.454068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.454346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.455467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.455793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.457410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.457725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.458012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.458308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.458597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.458926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.459214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.459501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.459797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.460090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.472507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.472799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.473087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.473373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.473690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.473983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.474264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.475869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.476167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.477011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.477304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.478147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.478147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.478593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.493868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.497119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.497945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.500578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.501224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.502241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.503878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.504162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.504521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.504714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.506359 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.508040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.508467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.509319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.511994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.513626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.516269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.516963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.517256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.517560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.517835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.517937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.521308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.521625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.521916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.522194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.527346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.527641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.528019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.532085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.532381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.532690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.535845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.536127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.536407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.536686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.536962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.537237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.537508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.537818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.538095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.538366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.538636 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.539496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.539776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.540039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.541406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 12:44:28.541717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.542011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.542294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.542570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.542860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.543137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.543407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.543690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.543963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.544250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.544523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.544792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.545055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 12:44:28.577461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a9817a19c0 pid: 80224 (default app) Jun 08 12:44:28.580935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eda9b8-8e0d-4ce8-8fee-fb75a95c3c71 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:28.581233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eda9b8-8e0d-4ce8-8fee-fb75a95c3c71 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:28.581515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eda9b8-8e0d-4ce8-8fee-fb75a95c3c71 None None] PATH_INFO: `/v3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:28.583198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a9817a19c0 pid: 80223 (default app) Jun 08 12:44:28.586312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Wed Jun 8 12:44:28 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:37.168059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82ba3-817f-4663-8abe-bff12de4bddd None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:37.168575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82ba3-817f-4663-8abe-bff12de4bddd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:37.168659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82ba3-817f-4663-8abe-bff12de4bddd None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:37.172945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:44:37.178848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:37.179473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:37.179473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:37.251162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: INFO dbcounter [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] Registered counter for database keystone Jun 08 12:44:37.275155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG oslo_db.sqlalchemy.engines [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 12:44:37.282541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writer thread running {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 12:44:37.591186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG passlib.handlers.bcrypt [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80224) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 08 12:44:37.591616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG passlib.handlers.bcrypt [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80224) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 08 12:44:37.650084 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:37.651747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:37.802224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 624 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 08 12:44:38.000067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e82ba3-817f-4663-8abe-bff12de4bddd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:38.071366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: INFO dbcounter [None req-26e82ba3-817f-4663-8abe-bff12de4bddd None None] Registered counter for database keystone Jun 08 12:44:38.094710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG oslo_db.sqlalchemy.engines [None req-26e82ba3-817f-4663-8abe-bff12de4bddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 12:44:38.107393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writer thread running {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 12:44:38.348844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e82ba3-817f-4663-8abe-bff12de4bddd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:38.354110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91139c76-0c7a-46f2-a00f-8e8c46db11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:38.354791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139c76-0c7a-46f2-a00f-8e8c46db11fb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:38.355078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139c76-0c7a-46f2-a00f-8e8c46db11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:38.355356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139c76-0c7a-46f2-a00f-8e8c46db11fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:38.364019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91139c76-0c7a-46f2-a00f-8e8c46db11fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:38.417789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING keystone.common.rbac_enforcer.enforcer [None req-91139c76-0c7a-46f2-a00f-8e8c46db11fb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 08 12:44:38.418141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91139c76-0c7a-46f2-a00f-8e8c46db11fb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:38.431778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Jun 8 12:44:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 12:44:38.438359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:38.454588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ba290-2edf-4d53-a9e4-35eaae7e9716 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:38.459367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588b1a0-9a65-467e-a2d5-b5143a5be673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:38.461129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b1a0-9a65-467e-a2d5-b5143a5be673 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:38.461426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b1a0-9a65-467e-a2d5-b5143a5be673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:38.461751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b1a0-9a65-467e-a2d5-b5143a5be673 admin admin] PATH_INFO: `/v3/projects/b549cbd5077d4178b499b2510c76f517` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:38.463308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588b1a0-9a65-467e-a2d5-b5143a5be673 admin admin] RBAC: Authorizing `identity:get_project(project_id=b549cbd5077d4178b499b2510c76f517)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:38.513814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e588b1a0-9a65-467e-a2d5-b5143a5be673 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 08 12:44:38.514166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588b1a0-9a65-467e-a2d5-b5143a5be673 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:38.520388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Jun 8 12:44:38 2022] GET /identity/v3/projects/b549cbd5077d4178b499b2510c76f517 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:40.869233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb07bc-ae46-4e46-8926-33d90489900d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:40.869775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb07bc-ae46-4e46-8926-33d90489900d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:40.869859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb07bc-ae46-4e46-8926-33d90489900d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:40.873922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:44:40.879712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee284e-6f42-4ab2-8c4b-090d203f144d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:40.880348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee284e-6f42-4ab2-8c4b-090d203f144d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:40.880348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee284e-6f42-4ab2-8c4b-090d203f144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:40.899580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-73ee284e-6f42-4ab2-8c4b-090d203f144d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:40.901138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-73ee284e-6f42-4ab2-8c4b-090d203f144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:40.909188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 08 12:44:40.933500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb07bc-ae46-4e46-8926-33d90489900d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:40.946931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb07bc-ae46-4e46-8926-33d90489900d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:40.951258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61b357-b6a2-4b8f-966b-bd8885f0a00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:40.951950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61b357-b6a2-4b8f-966b-bd8885f0a00d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:40.952237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61b357-b6a2-4b8f-966b-bd8885f0a00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:40.952517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61b357-b6a2-4b8f-966b-bd8885f0a00d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:40.961962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61b357-b6a2-4b8f-966b-bd8885f0a00d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:40.963781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61b357-b6a2-4b8f-966b-bd8885f0a00d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:40.973325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Jun 8 12:44:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:44:40.979912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee284e-6f42-4ab2-8c4b-090d203f144d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:40.989288 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee284e-6f42-4ab2-8c4b-090d203f144d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:40.994291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbad57-2096-43f3-8c06-1a0c460165be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:40.995293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbad57-2096-43f3-8c06-1a0c460165be admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:40.995666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbad57-2096-43f3-8c06-1a0c460165be admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:40.996034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbad57-2096-43f3-8c06-1a0c460165be admin admin] PATH_INFO: `/v3/users/dad84ac759bb44c09343109fa742afe2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:40.997568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbad57-2096-43f3-8c06-1a0c460165be admin admin] RBAC: Authorizing `identity:get_user(user_id=dad84ac759bb44c09343109fa742afe2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:40.999434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbad57-2096-43f3-8c06-1a0c460165be admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:41.001035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Wed Jun 8 12:44:40 2022] GET /identity/v3/users/dad84ac759bb44c09343109fa742afe2 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:43.371010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f193d-35ee-47de-ade9-fec12358f948 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:43.371578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f193d-35ee-47de-ade9-fec12358f948 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:43.371578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f193d-35ee-47de-ade9-fec12358f948 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:43.372923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:43.378419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca1231-4689-403a-add9-a830e5de2133 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:43.378848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca1231-4689-403a-add9-a830e5de2133 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:43.379215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca1231-4689-403a-add9-a830e5de2133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:43.398965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bbca1231-4689-403a-add9-a830e5de2133 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:43.400250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bbca1231-4689-403a-add9-a830e5de2133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:43.432671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925fbf2-5cca-4a13-b7d8-ee97e8b4f3d0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:43.432964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925fbf2-5cca-4a13-b7d8-ee97e8b4f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:43.433247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925fbf2-5cca-4a13-b7d8-ee97e8b4f3d0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:43.434650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:44:43.439828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:43.440122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:43.440411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:43.482150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG passlib.handlers.bcrypt [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80223) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 08 12:44:43.482592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG passlib.handlers.bcrypt [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80223) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 08 12:44:43.493734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:44:43.518524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca1231-4689-403a-add9-a830e5de2133 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:43.530005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:43.531669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:43.544550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:43.642990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca1231-4689-403a-add9-a830e5de2133 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:43.643167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:44:43.681447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:43.700267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b88c3-295d-4784-b0f0-af1c98cbd14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:43.701582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b88c3-295d-4784-b0f0-af1c98cbd14b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:43.702057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b88c3-295d-4784-b0f0-af1c98cbd14b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:43.702540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b88c3-295d-4784-b0f0-af1c98cbd14b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:43.721315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b88c3-295d-4784-b0f0-af1c98cbd14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9a0b88c3-295d-4784-b0f0-af1c98cbd14b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:44:43.743357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:44:43.744302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:44:43.745049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:44:43.745650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:44:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:44:43.755010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b88c3-295d-4784-b0f0-af1c98cbd14b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:43.834878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18906f-ec49-476d-b933-9a5087045987 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:43.837941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:43.874557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:43.881161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253091f-ce65-4700-9510-4630ecb8c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:43.882339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253091f-ce65-4700-9510-4630ecb8c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:43.882682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253091f-ce65-4700-9510-4630ecb8c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:43.883043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253091f-ce65-4700-9510-4630ecb8c9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:43.901633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b88c3-295d-4784-b0f0-af1c98cbd14b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:43.942957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:43.943913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:43.944218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:43.945719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:43.945940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:44:43.946265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:43.948452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:43.967680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253091f-ce65-4700-9510-4630ecb8c9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:43.974436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:44:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:43.974613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253091f-ce65-4700-9510-4630ecb8c9e9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:43.975510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:44.110450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 12:44:44.116256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253091f-ce65-4700-9510-4630ecb8c9e9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:44.117328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e60fd-33a1-4399-b0e3-2854e5810f99 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:44.121414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:44.155820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b0fe5-eeae-4932-a7b6-d60703fda34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:44.156607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b0fe5-eeae-4932-a7b6-d60703fda34f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:44.156897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b0fe5-eeae-4932-a7b6-d60703fda34f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:44.157197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b0fe5-eeae-4932-a7b6-d60703fda34f None admin] PATH_INFO: `/v3/users/dad84ac759bb44c09343109fa742afe2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:44.158493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b0fe5-eeae-4932-a7b6-d60703fda34f None admin] RBAC: Authorizing `identity:get_user(user_id=dad84ac759bb44c09343109fa742afe2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:44.160019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b0fe5-eeae-4932-a7b6-d60703fda34f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:44.161707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:44:43 2022] GET /identity/v3/users/dad84ac759bb44c09343109fa742afe2 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:44.167340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b0fe5-eeae-4932-a7b6-d60703fda34f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:44.183742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:44.236315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253091f-ce65-4700-9510-4630ecb8c9e9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:44.272702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:44.273983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:44.274276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:44.274567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:44.282755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b0fe5-eeae-4932-a7b6-d60703fda34f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:44.294113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:44.295618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:44:44.317901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:44:44.320846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:44:44.321955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:44:44.321955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:44:44.321955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:44:44.321955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:44:44.321955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:44:44.322269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718d51-ea7c-461b-9e21-ef2af2761522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:44.322269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718d51-ea7c-461b-9e21-ef2af2761522 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:44.322269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718d51-ea7c-461b-9e21-ef2af2761522 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:44.322482 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718d51-ea7c-461b-9e21-ef2af2761522 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:44.323645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718d51-ea7c-461b-9e21-ef2af2761522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:44.325124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718d51-ea7c-461b-9e21-ef2af2761522 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:44.326487 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:44.326816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:44:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:44.332332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718d51-ea7c-461b-9e21-ef2af2761522 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:44.416141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:44.436648 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:44.457802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718d51-ea7c-461b-9e21-ef2af2761522 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:44.468684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faaaa8-df52-4fca-b3ae-ba4afe5738c5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:44.501091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243b693-f98c-4075-bebc-582b0408f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:44.501794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b693-f98c-4075-bebc-582b0408f56b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:44.502399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b693-f98c-4075-bebc-582b0408f56b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:44.502399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b693-f98c-4075-bebc-582b0408f56b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:44.503224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243b693-f98c-4075-bebc-582b0408f56b None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.domain.id=default, user.id=dad84ac759bb44c09343109fa742afe2) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:44:44.503549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243b693-f98c-4075-bebc-582b0408f56b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:44.505047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243b693-f98c-4075-bebc-582b0408f56b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:44.512396 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 11/20] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Jun 8 12:44:44 2022] GET /identity/v3/role_assignments?user.id=dad84ac759bb44c09343109fa742afe2&scope.domain.id=default&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 233 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:44.517285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c843c69-efca-4435-aa36-c6cd45518bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:44.518494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c843c69-efca-4435-aa36-c6cd45518bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:44.518960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c843c69-efca-4435-aa36-c6cd45518bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:44.519391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c843c69-efca-4435-aa36-c6cd45518bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:44.520775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c843c69-efca-4435-aa36-c6cd45518bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:44:44.521299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c843c69-efca-4435-aa36-c6cd45518bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:44.525128 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c843c69-efca-4435-aa36-c6cd45518bd2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:44.550134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 10/21] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:47.069469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b7087-253a-4af2-8b16-21c99b80207e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.070650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b7087-253a-4af2-8b16-21c99b80207e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.071165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b7087-253a-4af2-8b16-21c99b80207e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.072780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 12/22] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:47.078558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14d35-6f32-4978-adae-44368f160895 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.079431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14d35-6f32-4978-adae-44368f160895 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.079910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14d35-6f32-4978-adae-44368f160895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.106588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4df14d35-6f32-4978-adae-44368f160895 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:47.108139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4df14d35-6f32-4978-adae-44368f160895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:47.219377 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 11/23] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:44:47.265042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b7087-253a-4af2-8b16-21c99b80207e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:47.404342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b7087-253a-4af2-8b16-21c99b80207e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:47.455759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458de9a6-3dd4-449c-806a-f9280de2b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:47.456627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de9a6-3dd4-449c-806a-f9280de2b65f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.456928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de9a6-3dd4-449c-806a-f9280de2b65f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.457215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de9a6-3dd4-449c-806a-f9280de2b65f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.478557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458de9a6-3dd4-449c-806a-f9280de2b65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-458de9a6-3dd4-449c-806a-f9280de2b65f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:44:47.486432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:44:47.487305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:44:47.488061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 13/24] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:44:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:44:47.494304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df14d35-6f32-4978-adae-44368f160895 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:47.568902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:47.642327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df14d35-6f32-4978-adae-44368f160895 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:47.650879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd750-5e64-4b7b-9b8a-913d65e2ced5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.651675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd750-5e64-4b7b-9b8a-913d65e2ced5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.652163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd750-5e64-4b7b-9b8a-913d65e2ced5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.653793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 14/25] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:47.659371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a878ef-a8b8-43ae-bd6b-da9044b9c8b6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.659932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a878ef-a8b8-43ae-bd6b-da9044b9c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.660413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a878ef-a8b8-43ae-bd6b-da9044b9c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.681335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:47.698268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:47.698560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-03a878ef-a8b8-43ae-bd6b-da9044b9c8b6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:47.699316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.699618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.699909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.700684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:44:47.700786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-03a878ef-a8b8-43ae-bd6b-da9044b9c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:47.700999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:47.702454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:47.726721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 12/26] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:44:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:47.733920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:47.870777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3ad25-9d76-4a7a-ab9e-fa1de70f1735 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:47.878958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 15/27] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:44:47.880646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb67f0-316e-4261-8d20-dd789106fdfb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.881147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb67f0-316e-4261-8d20-dd789106fdfb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.881352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:47.881746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb67f0-316e-4261-8d20-dd789106fdfb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.884421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 16/28] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:47.893854 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98687ee-2035-4f2e-89aa-9be0737388d6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.894153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98687ee-2035-4f2e-89aa-9be0737388d6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.894438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98687ee-2035-4f2e-89aa-9be0737388d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.911191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d03229-6f1e-4024-abae-98221ffcf139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:47.912014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03229-6f1e-4024-abae-98221ffcf139 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:47.912295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03229-6f1e-4024-abae-98221ffcf139 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:47.912579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d03229-6f1e-4024-abae-98221ffcf139 None admin] PATH_INFO: `/v3/users/dad84ac759bb44c09343109fa742afe2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:47.914372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d03229-6f1e-4024-abae-98221ffcf139 None admin] RBAC: Authorizing `identity:get_user(user_id=dad84ac759bb44c09343109fa742afe2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:47.916104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d03229-6f1e-4024-abae-98221ffcf139 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:47.918320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 13/29] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:44:47 2022] GET /identity/v3/users/dad84ac759bb44c09343109fa742afe2 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:47.923375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d03229-6f1e-4024-abae-98221ffcf139 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:47.935332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c98687ee-2035-4f2e-89aa-9be0737388d6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:47.936871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c98687ee-2035-4f2e-89aa-9be0737388d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:48.055836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d03229-6f1e-4024-abae-98221ffcf139 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:48.079663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 17/30] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:44:48.080602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98687ee-2035-4f2e-89aa-9be0737388d6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:48.095187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81205d-3efe-497d-b17a-a554b7b02c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:48.096556 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81205d-3efe-497d-b17a-a554b7b02c76 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:48.096990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81205d-3efe-497d-b17a-a554b7b02c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:48.097416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81205d-3efe-497d-b17a-a554b7b02c76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:48.098981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81205d-3efe-497d-b17a-a554b7b02c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:48.101133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81205d-3efe-497d-b17a-a554b7b02c76 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:48.103093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 14/31] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:44:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:48.110619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81205d-3efe-497d-b17a-a554b7b02c76 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:48.170318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:48.207663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:48.238954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81205d-3efe-497d-b17a-a554b7b02c76 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:48.266943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98687ee-2035-4f2e-89aa-9be0737388d6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:48.284192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92cf1-4ae9-4c2c-b7b4-ece1ce80611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:48.285515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92cf1-4ae9-4c2c-b7b4-ece1ce80611d None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:48.286073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92cf1-4ae9-4c2c-b7b4-ece1ce80611d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:48.286603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92cf1-4ae9-4c2c-b7b4-ece1ce80611d None admin] PATH_INFO: `/v3/domains/default/users/dad84ac759bb44c09343109fa742afe2/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:48.288961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92cf1-4ae9-4c2c-b7b4-ece1ce80611d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dad84ac759bb44c09343109fa742afe2, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:48.290877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92cf1-4ae9-4c2c-b7b4-ece1ce80611d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:48.314027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:48.314902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:48.315281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:48.315553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:48.329613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:48.331154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:44:48.351782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:44:48.352656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:44:48.354020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:44:48.354020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:44:48.354020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:44:48.354020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:44:48.354020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 18/32] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:44:48.354467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:48.431985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 15/33] 10.222.0.46 () {58 vars in 1361 bytes} [Wed Jun 8 12:44:48 2022] PUT /identity/v3/domains/default/users/dad84ac759bb44c09343109fa742afe2/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:44:48.434330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122f48-7a4e-4774-8140-3b79513966d7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:48.434874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122f48-7a4e-4774-8140-3b79513966d7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:48.435464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122f48-7a4e-4774-8140-3b79513966d7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:48.440794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 16/34] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:48.442123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50122f48-7a4e-4774-8140-3b79513966d7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:48.482290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c83dd-e477-4ad9-97f4-4c973f3271d5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:48.507976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:48.540684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082495-a8b7-4a6e-b933-96c6f4a21374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:48.542629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082495-a8b7-4a6e-b933-96c6f4a21374 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:48.544577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082495-a8b7-4a6e-b933-96c6f4a21374 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:48.545112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082495-a8b7-4a6e-b933-96c6f4a21374 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:48.546341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082495-a8b7-4a6e-b933-96c6f4a21374 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:48.548807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082495-a8b7-4a6e-b933-96c6f4a21374 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:48.609959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50122f48-7a4e-4774-8140-3b79513966d7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:48.614489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:48.683152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:48.683772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:48.684069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:48.684358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:48.685218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:44:48.685585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:48.687223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:48.695923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 19/35] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 8 12:44:48 2022] POST /identity/v3/roles => generated 225 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:44:48.697298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da16e-d7ce-48e1-897e-a906d6e9fc5e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:48.697623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da16e-d7ce-48e1-897e-a906d6e9fc5e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:48.697918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da16e-d7ce-48e1-897e-a906d6e9fc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:48.719707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 17/36] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:48.725129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:48.739143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ca0da16e-d7ce-48e1-897e-a906d6e9fc5e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:48.743144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca0da16e-d7ce-48e1-897e-a906d6e9fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:48.893337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 20/37] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:44:48.935964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0df00-422c-4ab7-b420-5c7cb6a9b306 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:48.974248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da16e-d7ce-48e1-897e-a906d6e9fc5e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:48.997201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36913-1b93-4877-991f-26158672ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:48.997852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36913-1b93-4877-991f-26158672ec2d None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:48.998147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36913-1b93-4877-991f-26158672ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:48.998435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36913-1b93-4877-991f-26158672ec2d None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:48.999172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c36913-1b93-4877-991f-26158672ec2d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:49.000665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c36913-1b93-4877-991f-26158672ec2d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:49.047752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 18/38] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:44:48 2022] POST /identity/v3/projects => generated 301 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:44:49.049730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabf1f-a15d-4604-8dd9-3e73811643b5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:49.050371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabf1f-a15d-4604-8dd9-3e73811643b5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:49.050922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabf1f-a15d-4604-8dd9-3e73811643b5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:49.053126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 19/39] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:49.059370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf548c4-5c98-4ff2-b4a0-437ca627bcbc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:49.059666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf548c4-5c98-4ff2-b4a0-437ca627bcbc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:49.059950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf548c4-5c98-4ff2-b4a0-437ca627bcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:49.089875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8cf548c4-5c98-4ff2-b4a0-437ca627bcbc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:49.091517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8cf548c4-5c98-4ff2-b4a0-437ca627bcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:49.105102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:49.130926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da16e-d7ce-48e1-897e-a906d6e9fc5e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:49.142871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:49.184783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1074-569f-4441-b662-2dd9bfcbad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:49.186089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1074-569f-4441-b662-2dd9bfcbad09 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:49.187035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1074-569f-4441-b662-2dd9bfcbad09 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:49.187492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1074-569f-4441-b662-2dd9bfcbad09 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:49.188769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb1074-569f-4441-b662-2dd9bfcbad09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:49.191269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb1074-569f-4441-b662-2dd9bfcbad09 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:49.201192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 20/40] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:44:49.219268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 8 12:44:48 2022] POST /identity/v3/roles => generated 219 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:44:49.235256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf548c4-5c98-4ff2-b4a0-437ca627bcbc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:49.378218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf548c4-5c98-4ff2-b4a0-437ca627bcbc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:49.419889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155c858-322e-4353-8f87-b833ec18c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:49.420593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c858-322e-4353-8f87-b833ec18c471 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:49.420890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c858-322e-4353-8f87-b833ec18c471 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:49.421180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c858-322e-4353-8f87-b833ec18c471 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:49.422051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155c858-322e-4353-8f87-b833ec18c471 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:49.423668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155c858-322e-4353-8f87-b833ec18c471 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:49.442854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 8 12:44:49 2022] POST /identity/v3/roles => generated 223 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:44:49.613382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193f1b-8673-41c1-be21-e61f1d4e8692 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:49.613382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193f1b-8673-41c1-be21-e61f1d4e8692 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:49.613382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193f1b-8673-41c1-be21-e61f1d4e8692 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:49.614291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 22/43] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:49.621285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641126f-fe6e-46dc-8105-554e457b4963 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:49.621980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641126f-fe6e-46dc-8105-554e457b4963 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:49.622487 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641126f-fe6e-46dc-8105-554e457b4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:49.635528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:49.641892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8641126f-fe6e-46dc-8105-554e457b4963 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:49.643757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8641126f-fe6e-46dc-8105-554e457b4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:49.726301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 22/44] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:44:49.750943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd193f1b-8673-41c1-be21-e61f1d4e8692 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:49.855886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd193f1b-8673-41c1-be21-e61f1d4e8692 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:49.889532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b97f3e-632e-496b-89a4-7338eebf105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:49.890357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97f3e-632e-496b-89a4-7338eebf105b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:49.890654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97f3e-632e-496b-89a4-7338eebf105b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:49.890943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97f3e-632e-496b-89a4-7338eebf105b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:49.892133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b97f3e-632e-496b-89a4-7338eebf105b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:49.893642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b97f3e-632e-496b-89a4-7338eebf105b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:49.895271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 23/45] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:44:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:49.901054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641126f-fe6e-46dc-8105-554e457b4963 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:50.003330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641126f-fe6e-46dc-8105-554e457b4963 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:50.041656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761374f-d055-4a97-89d6-de5baea2db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:50.042334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761374f-d055-4a97-89d6-de5baea2db9c None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:50.042628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761374f-d055-4a97-89d6-de5baea2db9c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:50.042913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761374f-d055-4a97-89d6-de5baea2db9c None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:50.043636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761374f-d055-4a97-89d6-de5baea2db9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:50.045115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761374f-d055-4a97-89d6-de5baea2db9c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:50.049488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:50.073964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:44:49 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:44:51.680981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208f9c-2cce-45a5-b479-989f65dabf98 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:51.681598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208f9c-2cce-45a5-b479-989f65dabf98 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:51.681598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208f9c-2cce-45a5-b479-989f65dabf98 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:51.682909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 24/47] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:51.688757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeacf6-0be7-4554-9f36-c0a11a560699 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:51.689350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeacf6-0be7-4554-9f36-c0a11a560699 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:51.689350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeacf6-0be7-4554-9f36-c0a11a560699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:51.707134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-eddeacf6-0be7-4554-9f36-c0a11a560699 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:51.708326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eddeacf6-0be7-4554-9f36-c0a11a560699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:51.802942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 24/48] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:44:51.826474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208f9c-2cce-45a5-b479-989f65dabf98 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:51.866387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:51.958656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208f9c-2cce-45a5-b479-989f65dabf98 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:52.003413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5da0ba-d47f-4421-9ed5-b8f6f4e680c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:52.004232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da0ba-d47f-4421-9ed5-b8f6f4e680c0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:52.004529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da0ba-d47f-4421-9ed5-b8f6f4e680c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:52.004826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da0ba-d47f-4421-9ed5-b8f6f4e680c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:52.017331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5da0ba-d47f-4421-9ed5-b8f6f4e680c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ad5da0ba-d47f-4421-9ed5-b8f6f4e680c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:44:52.025196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:44:52.027085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:44:52.028847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 25/49] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:44:52.037390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeacf6-0be7-4554-9f36-c0a11a560699 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:52.192171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeacf6-0be7-4554-9f36-c0a11a560699 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:52.213208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:52.238328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:52.239053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:52.239343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:52.239626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:52.240443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:44:52.240767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:52.243482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:52.254687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 25/50] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:52.260819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5da0ba-d47f-4421-9ed5-b8f6f4e680c0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:52.374686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:52.384055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5da0ba-d47f-4421-9ed5-b8f6f4e680c0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:52.426985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bb081-1e0d-4d6a-b082-5cf38324f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:52.427976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb081-1e0d-4d6a-b082-5cf38324f986 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:52.428281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb081-1e0d-4d6a-b082-5cf38324f986 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:52.429097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb081-1e0d-4d6a-b082-5cf38324f986 None admin] PATH_INFO: `/v3/users/dad84ac759bb44c09343109fa742afe2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:52.430568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb081-1e0d-4d6a-b082-5cf38324f986 None admin] RBAC: Authorizing `identity:get_user(user_id=dad84ac759bb44c09343109fa742afe2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:52.432186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb081-1e0d-4d6a-b082-5cf38324f986 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:52.434275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 26/51] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:44:52 2022] GET /identity/v3/users/dad84ac759bb44c09343109fa742afe2 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:44:52.441808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:52.562503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3bb95-961c-46d3-852e-2a05a5df24ce None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:52.604015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd5cd-7dbe-4f20-9612-aab9bd41977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:52.604823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd5cd-7dbe-4f20-9612-aab9bd41977b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:52.605208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd5cd-7dbe-4f20-9612-aab9bd41977b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:52.605388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd5cd-7dbe-4f20-9612-aab9bd41977b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:52.606664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efd5cd-7dbe-4f20-9612-aab9bd41977b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:52.608217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efd5cd-7dbe-4f20-9612-aab9bd41977b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:52.610039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 26/52] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:44:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:52.615460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569d5c-807a-4e05-983f-9768a963dacc None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:52.615755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569d5c-807a-4e05-983f-9768a963dacc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:52.616209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd5cd-7dbe-4f20-9612-aab9bd41977b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:52.616439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569d5c-807a-4e05-983f-9768a963dacc None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:52.618276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 27/53] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:52.623857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5df3-8d03-44dd-99f8-7ad4e130cd81 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:52.624153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5df3-8d03-44dd-99f8-7ad4e130cd81 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:52.624542 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5df3-8d03-44dd-99f8-7ad4e130cd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:52.643046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7cef5df3-8d03-44dd-99f8-7ad4e130cd81 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:52.644260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7cef5df3-8d03-44dd-99f8-7ad4e130cd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:52.677022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:52.744009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 28/54] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:44:52.748999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd5cd-7dbe-4f20-9612-aab9bd41977b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:52.779569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef5df3-8d03-44dd-99f8-7ad4e130cd81 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:52.798052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:52.799224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:52.799740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:52.800240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:52.801854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.domain.id=default, user.id=dad84ac759bb44c09343109fa742afe2) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:44:52.802428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:52.805229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:52.820584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Jun 8 12:44:52 2022] GET /identity/v3/role_assignments?user.id=dad84ac759bb44c09343109fa742afe2&scope.domain.id=default&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 530 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:52.935840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:52.949438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef5df3-8d03-44dd-99f8-7ad4e130cd81 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:53.000082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbefdc-bbaa-440e-a640-33cf280a6fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:53.000940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbefdc-bbaa-440e-a640-33cf280a6fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:53.001215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbefdc-bbaa-440e-a640-33cf280a6fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:53.001502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbefdc-bbaa-440e-a640-33cf280a6fc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:53.002817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbefdc-bbaa-440e-a640-33cf280a6fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:53.004345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbefdc-bbaa-440e-a640-33cf280a6fc4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:53.006112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 29/56] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:44:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:53.012445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:53.135840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdc1f-ccf6-4816-9834-301dd886e4d4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:53.153795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:53.187097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f201b-97b5-41e6-b0fa-927bdd803cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:53.187782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f201b-97b5-41e6-b0fa-927bdd803cc0 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:53.188073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f201b-97b5-41e6-b0fa-927bdd803cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:53.188352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f201b-97b5-41e6-b0fa-927bdd803cc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:53.189087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f201b-97b5-41e6-b0fa-927bdd803cc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:53.190638 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f201b-97b5-41e6-b0fa-927bdd803cc0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:53.219834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 28/57] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Jun 8 12:44:53 2022] POST /identity/v3/projects => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:44:55.622208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11622ab8-499d-4169-86b0-518723ec3718 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:55.622718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11622ab8-499d-4169-86b0-518723ec3718 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:55.622830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11622ab8-499d-4169-86b0-518723ec3718 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:55.624166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 30/58] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:44:55.631435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567be24-a16b-485a-bb44-12a2df7aabc3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:55.631940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567be24-a16b-485a-bb44-12a2df7aabc3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:55.632302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567be24-a16b-485a-bb44-12a2df7aabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:55.655416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7567be24-a16b-485a-bb44-12a2df7aabc3 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:55.657020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7567be24-a16b-485a-bb44-12a2df7aabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:44:55.748726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 29/59] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:44:55.777126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11622ab8-499d-4169-86b0-518723ec3718 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:55.884613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11622ab8-499d-4169-86b0-518723ec3718 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:55.918487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ebe0-b6e0-4fb7-8b59-6c3ece0c5752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:55.919280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ebe0-b6e0-4fb7-8b59-6c3ece0c5752 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:55.919574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ebe0-b6e0-4fb7-8b59-6c3ece0c5752 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:55.919858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ebe0-b6e0-4fb7-8b59-6c3ece0c5752 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:55.921054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7ebe0-b6e0-4fb7-8b59-6c3ece0c5752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:55.922543 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7ebe0-b6e0-4fb7-8b59-6c3ece0c5752 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:55.924197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 31/60] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:44:55.930386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567be24-a16b-485a-bb44-12a2df7aabc3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:44:56.048490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:44:56.059387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567be24-a16b-485a-bb44-12a2df7aabc3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:44:56.105723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3806-c3ba-4741-bc59-ff0436f256c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:44:56.106646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3806-c3ba-4741-bc59-ff0436f256c3 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:56.107046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3806-c3ba-4741-bc59-ff0436f256c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:56.107410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3806-c3ba-4741-bc59-ff0436f256c3 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:56.108445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b3806-c3ba-4741-bc59-ff0436f256c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:44:56.110417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b3806-c3ba-4741-bc59-ff0436f256c3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:44:56.145112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 30/61] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:44:55 2022] POST /identity/v3/users => generated 275 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:44:59.884635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82459854-2cfc-4a6a-aae2-22e513e19bd6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:59.885811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82459854-2cfc-4a6a-aae2-22e513e19bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:59.886334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82459854-2cfc-4a6a-aae2-22e513e19bd6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:59.888011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 32/62] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:44:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:44:59.893658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7f2b-d624-44c8-9d85-f16e1b4f15b6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:44:59.894579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7f2b-d624-44c8-9d85-f16e1b4f15b6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:44:59.895078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7f2b-d624-44c8-9d85-f16e1b4f15b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:44:59.918564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-517f7f2b-d624-44c8-9d85-f16e1b4f15b6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:44:59.920113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-517f7f2b-d624-44c8-9d85-f16e1b4f15b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:00.044848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 31/63] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:00.081783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82459854-2cfc-4a6a-aae2-22e513e19bd6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:00.129579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:00.186670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66246fa-9fa4-4beb-9336-01c7f436b1e5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.186960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66246fa-9fa4-4beb-9336-01c7f436b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.187157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66246fa-9fa4-4beb-9336-01c7f436b1e5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.188535 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 32/64] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:45:00.194588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292c935-f751-4937-97a9-e941f791f87c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.195188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292c935-f751-4937-97a9-e941f791f87c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.195701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292c935-f751-4937-97a9-e941f791f87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.223103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0292c935-f751-4937-97a9-e941f791f87c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:00.226749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0292c935-f751-4937-97a9-e941f791f87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:00.262234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82459854-2cfc-4a6a-aae2-22e513e19bd6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:00.323353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c04b2-6191-49bf-b6bb-936764aa43e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:00.324188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c04b2-6191-49bf-b6bb-936764aa43e6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.324479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c04b2-6191-49bf-b6bb-936764aa43e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.324764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c04b2-6191-49bf-b6bb-936764aa43e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.348032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c04b2-6191-49bf-b6bb-936764aa43e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4c2c04b2-6191-49bf-b6bb-936764aa43e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:00.356999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:00.357980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:00.358773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:00.361725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 33/65] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:00.369605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c04b2-6191-49bf-b6bb-936764aa43e6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:00.403862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 33/66] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:00.442040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292c935-f751-4937-97a9-e941f791f87c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:00.458092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:00.518039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:00.533495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c04b2-6191-49bf-b6bb-936764aa43e6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:00.576624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b06cfe-b3d2-4df7-bf13-4d51ac4d7ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:00.577494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b06cfe-b3d2-4df7-bf13-4d51ac4d7ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.577982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b06cfe-b3d2-4df7-bf13-4d51ac4d7ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.578368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b06cfe-b3d2-4df7-bf13-4d51ac4d7ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.579424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b06cfe-b3d2-4df7-bf13-4d51ac4d7ce1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:00.579831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b06cfe-b3d2-4df7-bf13-4d51ac4d7ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:00.582007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b06cfe-b3d2-4df7-bf13-4d51ac4d7ce1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:00.592219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292c935-f751-4937-97a9-e941f791f87c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:00.601981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 34/67] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:00.605119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684156-452e-4743-a909-1c0f424c7264 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.605719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684156-452e-4743-a909-1c0f424c7264 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.606450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684156-452e-4743-a909-1c0f424c7264 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.613710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 35/68] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:00.615153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88684156-452e-4743-a909-1c0f424c7264 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:00.658639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a26ee-0c9a-4fb3-b8c3-712b350015cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:00.661211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a26ee-0c9a-4fb3-b8c3-712b350015cb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.662288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a26ee-0c9a-4fb3-b8c3-712b350015cb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.663671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a26ee-0c9a-4fb3-b8c3-712b350015cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.681889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a26ee-0c9a-4fb3-b8c3-712b350015cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-090a26ee-0c9a-4fb3-b8c3-712b350015cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:00.695074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:00.696148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:00.697089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:00.699586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:00.701755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416280-a99e-429e-abd5-48cd4f0feeda None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.702491 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416280-a99e-429e-abd5-48cd4f0feeda None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.702930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416280-a99e-429e-abd5-48cd4f0feeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.726413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-79416280-a99e-429e-abd5-48cd4f0feeda None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:00.728399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-79416280-a99e-429e-abd5-48cd4f0feeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:00.766643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88684156-452e-4743-a909-1c0f424c7264 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:00.802669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:00.809718 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 35/70] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:00.814913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98992dd9-4094-4582-be9c-b548fa709f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:00.815050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79416280-a99e-429e-abd5-48cd4f0feeda None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:00.815142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992dd9-4094-4582-be9c-b548fa709f07 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.815395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992dd9-4094-4582-be9c-b548fa709f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.815686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992dd9-4094-4582-be9c-b548fa709f07 None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.831514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98992dd9-4094-4582-be9c-b548fa709f07 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:00.833727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98992dd9-4094-4582-be9c-b548fa709f07 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:00.836308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:00 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:00.837387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d82e-d9c7-446f-ad9b-f8db5f730de0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.837709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d82e-d9c7-446f-ad9b-f8db5f730de0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.838075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d82e-d9c7-446f-ad9b-f8db5f730de0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.841708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 37/72] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:00.842856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8d82e-d9c7-446f-ad9b-f8db5f730de0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:00.858227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:00.927963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79416280-a99e-429e-abd5-48cd4f0feeda None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:00.964117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a4096-5b70-42c3-bdd6-8228eb7b27a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:00.964716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a4096-5b70-42c3-bdd6-8228eb7b27a2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.965005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a4096-5b70-42c3-bdd6-8228eb7b27a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.965291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a4096-5b70-42c3-bdd6-8228eb7b27a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.966091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a4096-5b70-42c3-bdd6-8228eb7b27a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:00.966405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a4096-5b70-42c3-bdd6-8228eb7b27a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:00.967817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a4096-5b70-42c3-bdd6-8228eb7b27a2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:00.976641 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:00.977954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1335-6913-4736-8adc-5b6c7f794d52 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:00.978253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1335-6913-4736-8adc-5b6c7f794d52 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:00.978361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8d82e-d9c7-446f-ad9b-f8db5f730de0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:00.978762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1335-6913-4736-8adc-5b6c7f794d52 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:00.979886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 37/74] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:00.980500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae1335-6913-4736-8adc-5b6c7f794d52 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.014764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a181c9-02fb-4427-ba90-8d41346b6aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.015590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a181c9-02fb-4427-ba90-8d41346b6aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.015876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a181c9-02fb-4427-ba90-8d41346b6aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.016160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a181c9-02fb-4427-ba90-8d41346b6aa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.027046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a181c9-02fb-4427-ba90-8d41346b6aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-57a181c9-02fb-4427-ba90-8d41346b6aa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:01.035181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:01.036144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:01.036916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 38/75] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:01.037885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3b5ba-8043-419e-a9c0-4cdad77dcb11 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.038225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3b5ba-8043-419e-a9c0-4cdad77dcb11 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.038518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3b5ba-8043-419e-a9c0-4cdad77dcb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.056642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9fb3b5ba-8043-419e-a9c0-4cdad77dcb11 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:01.058135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9fb3b5ba-8043-419e-a9c0-4cdad77dcb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:01.062630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.104308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae1335-6913-4736-8adc-5b6c7f794d52 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.120548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.127034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 39/76] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:01.127882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3b5ba-8043-419e-a9c0-4cdad77dcb11 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.142120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a296c9b-98f0-4dc7-85e4-6c142c3f188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.142882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a296c9b-98f0-4dc7-85e4-6c142c3f188f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.143179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a296c9b-98f0-4dc7-85e4-6c142c3f188f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.143467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a296c9b-98f0-4dc7-85e4-6c142c3f188f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.216169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a296c9b-98f0-4dc7-85e4-6c142c3f188f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:01.217610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a296c9b-98f0-4dc7-85e4-6c142c3f188f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:01.235137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3b5ba-8043-419e-a9c0-4cdad77dcb11 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.273069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b7cd2-c87a-464e-8259-3373ff8328f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.273990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b7cd2-c87a-464e-8259-3373ff8328f7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.274293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b7cd2-c87a-464e-8259-3373ff8328f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.274581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b7cd2-c87a-464e-8259-3373ff8328f7 None admin] PATH_INFO: `/v3/users/dad84ac759bb44c09343109fa742afe2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.275806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b7cd2-c87a-464e-8259-3373ff8328f7 None admin] RBAC: Authorizing `identity:get_user(user_id=dad84ac759bb44c09343109fa742afe2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:01.277281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b7cd2-c87a-464e-8259-3373ff8328f7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:01.278961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 40/77] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/users/dad84ac759bb44c09343109fa742afe2 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:01.280106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.280228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72536b53-c16f-42c8-bf9e-8dfa4f252e36 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.280401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72536b53-c16f-42c8-bf9e-8dfa4f252e36 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.280693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72536b53-c16f-42c8-bf9e-8dfa4f252e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.297868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-72536b53-c16f-42c8-bf9e-8dfa4f252e36 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:01.299083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-72536b53-c16f-42c8-bf9e-8dfa4f252e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:01.322399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 38/78] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:01.323348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a296c9b-98f0-4dc7-85e4-6c142c3f188f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.361414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.372438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 41/79] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:01.382519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72536b53-c16f-42c8-bf9e-8dfa4f252e36 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.433424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a296c9b-98f0-4dc7-85e4-6c142c3f188f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.469025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.469747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.470041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.470326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.471083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:01.471398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:01.472785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:01.481295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72536b53-c16f-42c8-bf9e-8dfa4f252e36 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.481991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 39/80] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:01.482802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.508317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.517605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d1f2-fe9d-4538-b683-4895dfed8aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.518418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d1f2-fe9d-4538-b683-4895dfed8aab None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.518715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d1f2-fe9d-4538-b683-4895dfed8aab None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.519004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d1f2-fe9d-4538-b683-4895dfed8aab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.520185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171d1f2-fe9d-4538-b683-4895dfed8aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:01.521698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171d1f2-fe9d-4538-b683-4895dfed8aab None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:01.523985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 42/81] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:01.524759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d1f2-fe9d-4538-b683-4895dfed8aab None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.586451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.590875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6d01b-e251-41ef-81c5-46a8be42fb38 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.624052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f776f-54aa-4534-9323-52da2dbe68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.624223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d1f2-fe9d-4538-b683-4895dfed8aab None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.624712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f776f-54aa-4534-9323-52da2dbe68bf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.625003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f776f-54aa-4534-9323-52da2dbe68bf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.625290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f776f-54aa-4534-9323-52da2dbe68bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.659734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903e76c-29d2-4be6-913f-496694f302a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.660606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e76c-29d2-4be6-913f-496694f302a0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.660906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e76c-29d2-4be6-913f-496694f302a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.661188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e76c-29d2-4be6-913f-496694f302a0 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.662413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903e76c-29d2-4be6-913f-496694f302a0 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:01.663978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903e76c-29d2-4be6-913f-496694f302a0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:01.665712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 43/82] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:01.666483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903e76c-29d2-4be6-913f-496694f302a0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.699275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f776f-54aa-4534-9323-52da2dbe68bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:01.700787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f776f-54aa-4534-9323-52da2dbe68bf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:01.724974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.765059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903e76c-29d2-4be6-913f-496694f302a0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.795684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.801438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf2adf-938e-4c83-a6f5-2d8bc0262678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.801885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 40/83] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:01.802280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2adf-938e-4c83-a6f5-2d8bc0262678 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.802581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2adf-938e-4c83-a6f5-2d8bc0262678 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.802867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2adf-938e-4c83-a6f5-2d8bc0262678 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.806797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f776f-54aa-4534-9323-52da2dbe68bf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.814101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf2adf-938e-4c83-a6f5-2d8bc0262678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-44cf2adf-938e-4c83-a6f5-2d8bc0262678 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:01.822282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:01.823177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:01.823972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 44/84] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:01.824599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf2adf-938e-4c83-a6f5-2d8bc0262678 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.906765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f776f-54aa-4534-9323-52da2dbe68bf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.927363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf2adf-938e-4c83-a6f5-2d8bc0262678 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:01.930779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:01.941942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0db15-77ef-4ea3-9bc2-86129a7c1f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.942840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0db15-77ef-4ea3-9bc2-86129a7c1f2a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.943133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0db15-77ef-4ea3-9bc2-86129a7c1f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.943416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0db15-77ef-4ea3-9bc2-86129a7c1f2a None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.944660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0db15-77ef-4ea3-9bc2-86129a7c1f2a None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:01.946325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0db15-77ef-4ea3-9bc2-86129a7c1f2a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:01.948307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 41/85] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:01.950610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0db15-77ef-4ea3-9bc2-86129a7c1f2a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:01.961939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb6a2-6f47-41db-9228-777e73f43e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:01.962624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb6a2-6f47-41db-9228-777e73f43e4a None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:01.962917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb6a2-6f47-41db-9228-777e73f43e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:01.963202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb6a2-6f47-41db-9228-777e73f43e4a None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:01.963922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb6a2-6f47-41db-9228-777e73f43e4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:01.965390 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb6a2-6f47-41db-9228-777e73f43e4a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:01.992606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 45/86] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:01 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:01.993394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb6a2-6f47-41db-9228-777e73f43e4a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:02.056876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:02.080592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0db15-77ef-4ea3-9bc2-86129a7c1f2a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:02.119867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb6a2-6f47-41db-9228-777e73f43e4a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:02.123999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:02.124916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:02.125384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:02.125925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:02.126964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] RBAC: Adding query filter params (role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=b569a1d3ddb44429977459c3b6277206, user.id=6d4c968bc8d646f3a5194fd6e06e5dc4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:02.127481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:02.129747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:02.137879 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 42/87] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/role_assignments?user.id=6d4c968bc8d646f3a5194fd6e06e5dc4&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:02.138754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:02.175844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042c98-14d3-433b-9500-fbac6507cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:02.178106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042c98-14d3-433b-9500-fbac6507cde5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:02.179198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042c98-14d3-433b-9500-fbac6507cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:02.179691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042c98-14d3-433b-9500-fbac6507cde5 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:02.182373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3042c98-14d3-433b-9500-fbac6507cde5 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:02.184620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3042c98-14d3-433b-9500-fbac6507cde5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:02.187623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 46/88] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:01 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:02.189113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042c98-14d3-433b-9500-fbac6507cde5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:02.223077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:02.294743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e1aa-b176-439e-a099-f7c278fbb391 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:02.329043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042c98-14d3-433b-9500-fbac6507cde5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:02.355623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:02.361413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:02.363133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:02.363133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:02.363133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:02.363517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:02.363844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:02.365311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:02.376275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 43/89] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:02.377733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:02.391345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5869c3-35b7-4645-92f1-9eae8d29c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:02.391345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5869c3-35b7-4645-92f1-9eae8d29c24f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:02.391345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5869c3-35b7-4645-92f1-9eae8d29c24f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:02.391345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5869c3-35b7-4645-92f1-9eae8d29c24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:02.479295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5869c3-35b7-4645-92f1-9eae8d29c24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:02.480872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5869c3-35b7-4645-92f1-9eae8d29c24f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:02.515770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff9a5-1c6b-4818-bb6a-c0683f229d5f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:02.537299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:02.557648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:02.558712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:02.559203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:02.559682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:02.561082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=b569a1d3ddb44429977459c3b6277206, user.id=dad84ac759bb44c09343109fa742afe2) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:02.561896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:02.564613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:02.571858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 44/90] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:02 2022] GET /identity/v3/role_assignments?user.id=dad84ac759bb44c09343109fa742afe2&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:02.573006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:02.625508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 47/91] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:02.627611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5869c3-35b7-4645-92f1-9eae8d29c24f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:02.650118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:02.755421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5869c3-35b7-4645-92f1-9eae8d29c24f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:02.779715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d323ab-d17a-42a3-8619-ebe8e4d517a0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:02.800777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855351-2864-4b2a-9c92-9f8eb7c8b5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:02.802237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855351-2864-4b2a-9c92-9f8eb7c8b5fd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:02.802746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855351-2864-4b2a-9c92-9f8eb7c8b5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:02.803661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855351-2864-4b2a-9c92-9f8eb7c8b5fd None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:02.805682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5855351-2864-4b2a-9c92-9f8eb7c8b5fd None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:02.807946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5855351-2864-4b2a-9c92-9f8eb7c8b5fd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:02.810765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 48/92] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:02 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:02.816962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855351-2864-4b2a-9c92-9f8eb7c8b5fd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:02.863454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a7c1c-9155-417d-96cd-c2f3c045432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:02.864697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7c1c-9155-417d-96cd-c2f3c045432b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:02.865157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7c1c-9155-417d-96cd-c2f3c045432b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:02.866258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7c1c-9155-417d-96cd-c2f3c045432b None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:02.870444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a7c1c-9155-417d-96cd-c2f3c045432b None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:02.872256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a7c1c-9155-417d-96cd-c2f3c045432b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:02.874320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 45/93] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:02 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:02.879761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a7c1c-9155-417d-96cd-c2f3c045432b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:02.923821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:02.943066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855351-2864-4b2a-9c92-9f8eb7c8b5fd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:02.973114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:02.987680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:02.988488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:02.988871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:02.989428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:02.990538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] RBAC: Adding query filter params (role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=b569a1d3ddb44429977459c3b6277206, user.id=6d4c968bc8d646f3a5194fd6e06e5dc4) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:02.991396 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:02.994821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:03.001280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 49/94] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:02 2022] GET /identity/v3/role_assignments?user.id=6d4c968bc8d646f3a5194fd6e06e5dc4&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=025cadb68d6641098d3edb9e47910aaf => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:03.067575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a7c1c-9155-417d-96cd-c2f3c045432b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:03.119334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf180ad-5465-4192-99a1-f26d605534b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:03.120029 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf180ad-5465-4192-99a1-f26d605534b9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:03.120317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf180ad-5465-4192-99a1-f26d605534b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:03.120603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf180ad-5465-4192-99a1-f26d605534b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:03.199403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf180ad-5465-4192-99a1-f26d605534b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:03.201035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf180ad-5465-4192-99a1-f26d605534b9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:03.273038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:03.340819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 46/95] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 12:45:03.346679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:03.464951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5f281-cdd8-4124-97d2-9289701b8a0c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:03.505098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d52b58-c7f9-4164-a7da-1367af171c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:03.506013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52b58-c7f9-4164-a7da-1367af171c16 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:03.506437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52b58-c7f9-4164-a7da-1367af171c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:03.506731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52b58-c7f9-4164-a7da-1367af171c16 None admin] PATH_INFO: `/v3/projects/cd75671c84b74a99be960915cbc32257` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:03.508125 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d52b58-c7f9-4164-a7da-1367af171c16 None admin] RBAC: Authorizing `identity:get_project(project_id=cd75671c84b74a99be960915cbc32257)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:03.509650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d52b58-c7f9-4164-a7da-1367af171c16 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:03.511608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 50/96] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:03 2022] GET /identity/v3/projects/cd75671c84b74a99be960915cbc32257 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:03.517219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf180ad-5465-4192-99a1-f26d605534b9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:03.626324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf180ad-5465-4192-99a1-f26d605534b9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:03.669395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849daf0-71d5-495c-8efa-4fd6bec1cf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:03.670116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849daf0-71d5-495c-8efa-4fd6bec1cf0e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:03.670410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849daf0-71d5-495c-8efa-4fd6bec1cf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:03.670700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849daf0-71d5-495c-8efa-4fd6bec1cf0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:03.671618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849daf0-71d5-495c-8efa-4fd6bec1cf0e None admin] RBAC: Adding query filter params (role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=cd75671c84b74a99be960915cbc32257, user.id=6d4c968bc8d646f3a5194fd6e06e5dc4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:03.671940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849daf0-71d5-495c-8efa-4fd6bec1cf0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:03.673450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849daf0-71d5-495c-8efa-4fd6bec1cf0e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:03.691104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 47/97] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:03 2022] GET /identity/v3/role_assignments?user.id=6d4c968bc8d646f3a5194fd6e06e5dc4&scope.project.id=cd75671c84b74a99be960915cbc32257&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:05.550600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220b08-a267-4557-969b-fe1398dcd645 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:05.551608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220b08-a267-4557-969b-fe1398dcd645 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:05.552101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220b08-a267-4557-969b-fe1398dcd645 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:05.553834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 51/98] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:05.559849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6893-38a8-4e78-b2fa-559481561687 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:05.560777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6893-38a8-4e78-b2fa-559481561687 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:05.561264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6893-38a8-4e78-b2fa-559481561687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:05.579943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bbbd6893-38a8-4e78-b2fa-559481561687 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:05.581615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bbbd6893-38a8-4e78-b2fa-559481561687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:05.586594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1100f91-c867-46a3-8b09-4974796a7c89 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:05.587204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1100f91-c867-46a3-8b09-4974796a7c89 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:05.587700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1100f91-c867-46a3-8b09-4974796a7c89 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:05.589601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 52/99] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:05.600313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:05.603048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43aba1-8a44-4326-92fa-50da6d4830ad None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:05.603341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43aba1-8a44-4326-92fa-50da6d4830ad None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:05.603620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43aba1-8a44-4326-92fa-50da6d4830ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:05.637733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6a43aba1-8a44-4326-92fa-50da6d4830ad None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:05.638968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6a43aba1-8a44-4326-92fa-50da6d4830ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:05.670048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:05.746501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 48/100] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:05.778435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 53/101] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:05.792896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd6893-38a8-4e78-b2fa-559481561687 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:05.833745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43aba1-8a44-4326-92fa-50da6d4830ad None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:05.998682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd6893-38a8-4e78-b2fa-559481561687 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:06.044780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43aba1-8a44-4326-92fa-50da6d4830ad None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:06.062950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019e183-a93e-426b-a14c-9b3b0679db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:06.064624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019e183-a93e-426b-a14c-9b3b0679db27 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.065374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019e183-a93e-426b-a14c-9b3b0679db27 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.065895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019e183-a93e-426b-a14c-9b3b0679db27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.067761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019e183-a93e-426b-a14c-9b3b0679db27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:06.070441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019e183-a93e-426b-a14c-9b3b0679db27 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:06.073107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 49/102] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:06.074790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fc47-fde5-40cb-b7c1-ecc232eb0514 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.075281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fc47-fde5-40cb-b7c1-ecc232eb0514 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.075769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fc47-fde5-40cb-b7c1-ecc232eb0514 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.077465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 50/103] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:06.083312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6fc47-fde5-40cb-b7c1-ecc232eb0514 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:06.096269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d348c-d628-4658-8d94-ea0bd28354a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:06.097095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d348c-d628-4658-8d94-ea0bd28354a5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.097386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d348c-d628-4658-8d94-ea0bd28354a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.097712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d348c-d628-4658-8d94-ea0bd28354a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.103958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:06.114021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d348c-d628-4658-8d94-ea0bd28354a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-379d348c-d628-4658-8d94-ea0bd28354a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:06.124704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:06.125626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:06.126381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:06.128842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 54/104] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:06.130591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d244635-5868-4959-9a56-9f3e44a39e10 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.131784 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d244635-5868-4959-9a56-9f3e44a39e10 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.132288 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d244635-5868-4959-9a56-9f3e44a39e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.149165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:06.164524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2d244635-5868-4959-9a56-9f3e44a39e10 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:06.167808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2d244635-5868-4959-9a56-9f3e44a39e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:06.270063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6fc47-fde5-40cb-b7c1-ecc232eb0514 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:06.284801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 55/105] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:06.285711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d244635-5868-4959-9a56-9f3e44a39e10 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:06.310418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7efb-2737-41c6-8f5c-b17fec60221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:06.311635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7efb-2737-41c6-8f5c-b17fec60221d None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.312126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7efb-2737-41c6-8f5c-b17fec60221d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.312620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7efb-2737-41c6-8f5c-b17fec60221d None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.313601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7efb-2737-41c6-8f5c-b17fec60221d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:06.315369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7efb-2737-41c6-8f5c-b17fec60221d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:06.345619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 51/106] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:45:06 2022] POST /identity/v3/projects => generated 302 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:45:06.347019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7a6c-df27-441e-8a0e-4d7121295cec None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.347319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7a6c-df27-441e-8a0e-4d7121295cec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.347611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7a6c-df27-441e-8a0e-4d7121295cec None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.349071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 52/107] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:06.351308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241e18f-dfed-4ef2-8bc3-d9c8caf70307 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.351882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241e18f-dfed-4ef2-8bc3-d9c8caf70307 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.352416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241e18f-dfed-4ef2-8bc3-d9c8caf70307 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.354921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 53/108] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:06.355984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241e18f-dfed-4ef2-8bc3-d9c8caf70307 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:06.448122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:06.449381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d244635-5868-4959-9a56-9f3e44a39e10 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:06.496475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322f66b-3984-4e31-87c2-5531c116c9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:06.497603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f66b-3984-4e31-87c2-5531c116c9af None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.498085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f66b-3984-4e31-87c2-5531c116c9af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.498616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f66b-3984-4e31-87c2-5531c116c9af None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.499685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322f66b-3984-4e31-87c2-5531c116c9af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:06.500310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322f66b-3984-4e31-87c2-5531c116c9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:06.502132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322f66b-3984-4e31-87c2-5531c116c9af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:06.504993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241e18f-dfed-4ef2-8bc3-d9c8caf70307 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:06.505303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:06.515816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 56/109] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:06.523116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dfe93-5505-4746-b7cc-fd9fc73f7a54 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.523734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dfe93-5505-4746-b7cc-fd9fc73f7a54 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.524230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dfe93-5505-4746-b7cc-fd9fc73f7a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.545328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5d0dfe93-5505-4746-b7cc-fd9fc73f7a54 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:06.546985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5d0dfe93-5505-4746-b7cc-fd9fc73f7a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:06.549321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790695-a8fa-4b14-ba1a-6421d42eeeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:06.550198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790695-a8fa-4b14-ba1a-6421d42eeeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.550490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790695-a8fa-4b14-ba1a-6421d42eeeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.550778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790695-a8fa-4b14-ba1a-6421d42eeeb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.566598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790695-a8fa-4b14-ba1a-6421d42eeeb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-58790695-a8fa-4b14-ba1a-6421d42eeeb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:06.576408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:06.577316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:06.578180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:06.580845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 54/110] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:06.586816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c72b9-8086-4be7-85de-60a1c27ba5f0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.587443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c72b9-8086-4be7-85de-60a1c27ba5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.587967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c72b9-8086-4be7-85de-60a1c27ba5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.608853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-055c72b9-8086-4be7-85de-60a1c27ba5f0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:06.610706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-055c72b9-8086-4be7-85de-60a1c27ba5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:06.629880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 57/111] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:06.633771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dfe93-5505-4746-b7cc-fd9fc73f7a54 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:06.741328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 55/112] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:06.742654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c72b9-8086-4be7-85de-60a1c27ba5f0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:06.787053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dfe93-5505-4746-b7cc-fd9fc73f7a54 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:06.818351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:06.829245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b288e-b31c-4f6f-bf38-b6ab672b7a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:06.830437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b288e-b31c-4f6f-bf38-b6ab672b7a30 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.830867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b288e-b31c-4f6f-bf38-b6ab672b7a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.831312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b288e-b31c-4f6f-bf38-b6ab672b7a30 None admin] PATH_INFO: `/v3/users/40bd204757d842c4a12a7f599b58fc6b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.838722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:06.851978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b288e-b31c-4f6f-bf38-b6ab672b7a30 None admin] RBAC: Authorizing `identity:get_user(user_id=40bd204757d842c4a12a7f599b58fc6b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:06.853919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b288e-b31c-4f6f-bf38-b6ab672b7a30 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:06.856279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 58/113] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:06 2022] GET /identity/v3/users/40bd204757d842c4a12a7f599b58fc6b => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:06.857416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b288e-b31c-4f6f-bf38-b6ab672b7a30 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:06.909259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c72b9-8086-4be7-85de-60a1c27ba5f0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:06.950122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:06.950781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:06.951085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:06.951365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:06.952527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:06.952527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:06.953931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:06.965586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 56/114] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:06.966467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:06.992003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b288e-b31c-4f6f-bf38-b6ab672b7a30 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.035456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92338e4-5e20-4bd6-b49e-0ab9b0ef37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.036701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92338e4-5e20-4bd6-b49e-0ab9b0ef37cb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.037219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92338e4-5e20-4bd6-b49e-0ab9b0ef37cb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.038364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92338e4-5e20-4bd6-b49e-0ab9b0ef37cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.051108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92338e4-5e20-4bd6-b49e-0ab9b0ef37cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e92338e4-5e20-4bd6-b49e-0ab9b0ef37cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:07.062152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:07.063085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:07.063917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:07.066150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 59/115] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:07.067183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92338e4-5e20-4bd6-b49e-0ab9b0ef37cb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.105253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb49c16-3551-4a74-bafe-ab271219e0d6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.124100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:07.134566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:07.146905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6b0c7-e272-423c-8738-255c547a6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.148261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b0c7-e272-423c-8738-255c547a6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.148577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b0c7-e272-423c-8738-255c547a6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.148837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b0c7-e272-423c-8738-255c547a6bb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.159956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6b0c7-e272-423c-8738-255c547a6bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-edb6b0c7-e272-423c-8738-255c547a6bb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:07.168095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:07.169012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:07.169835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 57/116] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:07.174827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6b0c7-e272-423c-8738-255c547a6bb8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.197665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92338e4-5e20-4bd6-b49e-0ab9b0ef37cb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.234129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbbceb-dd63-422b-9883-1d9a5edf6da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.234795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbbceb-dd63-422b-9883-1d9a5edf6da8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.235087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbbceb-dd63-422b-9883-1d9a5edf6da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.235371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbbceb-dd63-422b-9883-1d9a5edf6da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.287518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6b0c7-e272-423c-8738-255c547a6bb8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.312234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbbceb-dd63-422b-9883-1d9a5edf6da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:07.313776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbbceb-dd63-422b-9883-1d9a5edf6da8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:07.327858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6a29b-440e-4915-8bcd-076d58c4ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.328759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6a29b-440e-4915-8bcd-076d58c4ff57 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.329062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6a29b-440e-4915-8bcd-076d58c4ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.329349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6a29b-440e-4915-8bcd-076d58c4ff57 None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.330725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6a29b-440e-4915-8bcd-076d58c4ff57 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:07.332296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6a29b-440e-4915-8bcd-076d58c4ff57 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:07.339973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 58/117] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:07 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:07.339973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8048a-46ea-486c-80cd-691373838365 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.339973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8048a-46ea-486c-80cd-691373838365 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.339973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8048a-46ea-486c-80cd-691373838365 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.339973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 59/118] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:07.339973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8048a-46ea-486c-80cd-691373838365 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.370622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:07.415465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:07.438496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 60/119] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:07.444517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbbceb-dd63-422b-9883-1d9a5edf6da8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.478355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8048a-46ea-486c-80cd-691373838365 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.520084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.520763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.521070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.521366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.523174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:07.523494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:07.525103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:07.534233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 60/120] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:07.534988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.557777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbbceb-dd63-422b-9883-1d9a5edf6da8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.597080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8a63a-27a7-46ca-b128-e71eb97e05de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.597921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a63a-27a7-46ca-b128-e71eb97e05de None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.598213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a63a-27a7-46ca-b128-e71eb97e05de None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.598503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a63a-27a7-46ca-b128-e71eb97e05de None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.599293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8a63a-27a7-46ca-b128-e71eb97e05de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:07.599608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8a63a-27a7-46ca-b128-e71eb97e05de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:07.601945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8a63a-27a7-46ca-b128-e71eb97e05de None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:07.611267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 61/121] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:07.612555 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839ed61-bcfd-43fe-8302-1918f732d3a8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.612850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839ed61-bcfd-43fe-8302-1918f732d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.613133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839ed61-bcfd-43fe-8302-1918f732d3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.630903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a839ed61-bcfd-43fe-8302-1918f732d3a8 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:07.633439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a839ed61-bcfd-43fe-8302-1918f732d3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:07.635625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:07.659492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e834-8f8c-4601-a827-af24caef44ac None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.668541 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:07.699585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c795b1-ef6d-4cce-87b6-92b2156c4bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.700565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c795b1-ef6d-4cce-87b6-92b2156c4bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.700855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c795b1-ef6d-4cce-87b6-92b2156c4bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.701142 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c795b1-ef6d-4cce-87b6-92b2156c4bd5 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.702454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c795b1-ef6d-4cce-87b6-92b2156c4bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:07.703888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c795b1-ef6d-4cce-87b6-92b2156c4bd5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:07.705719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 61/122] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:07 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:07.706568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c795b1-ef6d-4cce-87b6-92b2156c4bd5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.716393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 62/123] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:07.718384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839ed61-bcfd-43fe-8302-1918f732d3a8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.842197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839ed61-bcfd-43fe-8302-1918f732d3a8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.846180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c795b1-ef6d-4cce-87b6-92b2156c4bd5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:07.880313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d1524-38a2-4815-aaec-05f0cde79491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.881811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d1524-38a2-4815-aaec-05f0cde79491 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.882238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d1524-38a2-4815-aaec-05f0cde79491 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.882645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d1524-38a2-4815-aaec-05f0cde79491 None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.883853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d1524-38a2-4815-aaec-05f0cde79491 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:07.885308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d1524-38a2-4815-aaec-05f0cde79491 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:07.891495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 63/124] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:07 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:07.891643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b6f5-2d60-4f79-a18e-830b31330a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:07.891743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d1524-38a2-4815-aaec-05f0cde79491 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.891812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b6f5-2d60-4f79-a18e-830b31330a9b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:07.891812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b6f5-2d60-4f79-a18e-830b31330a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:07.891812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b6f5-2d60-4f79-a18e-830b31330a9b None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:07.892279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161b6f5-2d60-4f79-a18e-830b31330a9b None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:07.893809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161b6f5-2d60-4f79-a18e-830b31330a9b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:07.895702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 62/125] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:07 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:07.896394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b6f5-2d60-4f79-a18e-830b31330a9b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:07.906944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:07.946138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:08.019124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b6f5-2d60-4f79-a18e-830b31330a9b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:08.019632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d1524-38a2-4815-aaec-05f0cde79491 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:08.059052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6d3b6-8e0e-4016-9cee-976391eed54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:08.059979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d3b6-8e0e-4016-9cee-976391eed54c None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.060248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d3b6-8e0e-4016-9cee-976391eed54c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.060563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d3b6-8e0e-4016-9cee-976391eed54c None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206/users/6d4c968bc8d646f3a5194fd6e06e5dc4/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.062512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6d3b6-8e0e-4016-9cee-976391eed54c None admin] RBAC: Authorizing `identity:create_grant(project_id=b569a1d3ddb44429977459c3b6277206, user_id=6d4c968bc8d646f3a5194fd6e06e5dc4, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:08.062610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ac22d-f766-4eed-bbf9-a989f54e37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:08.063688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac22d-f766-4eed-bbf9-a989f54e37a0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.064007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac22d-f766-4eed-bbf9-a989f54e37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.064097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6d3b6-8e0e-4016-9cee-976391eed54c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:08.064294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac22d-f766-4eed-bbf9-a989f54e37a0 None admin] PATH_INFO: `/v3/users/dad84ac759bb44c09343109fa742afe2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.065521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ac22d-f766-4eed-bbf9-a989f54e37a0 None admin] RBAC: Authorizing `identity:get_user(user_id=dad84ac759bb44c09343109fa742afe2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:08.067321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ac22d-f766-4eed-bbf9-a989f54e37a0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:08.069276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 64/126] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:07 2022] GET /identity/v3/users/dad84ac759bb44c09343109fa742afe2 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:08.075354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ac22d-f766-4eed-bbf9-a989f54e37a0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:08.097670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 63/127] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:07 2022] PUT /identity/v3/projects/b569a1d3ddb44429977459c3b6277206/users/6d4c968bc8d646f3a5194fd6e06e5dc4/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:08.097670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6d3b6-8e0e-4016-9cee-976391eed54c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:08.230127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:08.269590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ac22d-f766-4eed-bbf9-a989f54e37a0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:08.280902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6d3b6-8e0e-4016-9cee-976391eed54c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:08.283518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:08.322216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4445b-69da-4fca-9d3b-f77ad1b7fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:08.323623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4445b-69da-4fca-9d3b-f77ad1b7fe92 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.324100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4445b-69da-4fca-9d3b-f77ad1b7fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.324677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4445b-69da-4fca-9d3b-f77ad1b7fe92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.328944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746e95e-7cfa-427d-908b-3d32db67e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:08.330320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746e95e-7cfa-427d-908b-3d32db67e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.330812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746e95e-7cfa-427d-908b-3d32db67e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.331320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746e95e-7cfa-427d-908b-3d32db67e9d5 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.332952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746e95e-7cfa-427d-908b-3d32db67e9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:08.335488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746e95e-7cfa-427d-908b-3d32db67e9d5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:08.337051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4445b-69da-4fca-9d3b-f77ad1b7fe92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:08.337887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 64/128] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:08 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:08.338962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746e95e-7cfa-427d-908b-3d32db67e9d5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-78e4445b-69da-4fca-9d3b-f77ad1b7fe92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:08.347564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:08.348604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:08.349397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 65/129] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:08.351033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4445b-69da-4fca-9d3b-f77ad1b7fe92 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:08.526810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746e95e-7cfa-427d-908b-3d32db67e9d5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:08.532504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4445b-69da-4fca-9d3b-f77ad1b7fe92 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:08.583861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354fe7b-7c3d-4c70-9132-679bc1610ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:08.586894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354fe7b-7c3d-4c70-9132-679bc1610ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.587475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:08.588306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.588434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354fe7b-7c3d-4c70-9132-679bc1610ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.588850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.589125 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354fe7b-7c3d-4c70-9132-679bc1610ac4 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.589391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.590806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354fe7b-7c3d-4c70-9132-679bc1610ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:08.591193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] RBAC: Adding query filter params (role.id=c55bd507a50c4e61b27c205ea173975b, scope.project.id=b569a1d3ddb44429977459c3b6277206, user.id=40bd204757d842c4a12a7f599b58fc6b) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:08.591802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:08.592950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354fe7b-7c3d-4c70-9132-679bc1610ac4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:08.594480 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:08.595151 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 66/130] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:08 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:08.596119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354fe7b-7c3d-4c70-9132-679bc1610ac4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:08.599586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:08.606363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 65/131] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:08 2022] GET /identity/v3/role_assignments?user.id=40bd204757d842c4a12a7f599b58fc6b&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=c55bd507a50c4e61b27c205ea173975b => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:08.607472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:08.666829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:08.789497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7dc8c-cb45-44b3-a189-4dad6dbddb28 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:08.855392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354fe7b-7c3d-4c70-9132-679bc1610ac4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:08.860375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:08.861578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.862934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.863485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.864067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:08.864414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:08.865988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:08.877447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 66/132] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:08.878334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:08.909366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e855cf5-3a67-499b-bfd8-1a05686ea402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:08.910742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e855cf5-3a67-499b-bfd8-1a05686ea402 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.911314 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e855cf5-3a67-499b-bfd8-1a05686ea402 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.913137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e855cf5-3a67-499b-bfd8-1a05686ea402 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206/users/6d4c968bc8d646f3a5194fd6e06e5dc4/roles/025cadb68d6641098d3edb9e47910aaf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.916725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e855cf5-3a67-499b-bfd8-1a05686ea402 None admin] RBAC: Authorizing `identity:create_grant(project_id=b569a1d3ddb44429977459c3b6277206, user_id=6d4c968bc8d646f3a5194fd6e06e5dc4, role_id=025cadb68d6641098d3edb9e47910aaf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:08.919456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e855cf5-3a67-499b-bfd8-1a05686ea402 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:08.941690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 67/133] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:08 2022] PUT /identity/v3/projects/b569a1d3ddb44429977459c3b6277206/users/6d4c968bc8d646f3a5194fd6e06e5dc4/roles/025cadb68d6641098d3edb9e47910aaf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:08.948047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b386b-0df8-40ce-bee1-81f5f3be60b8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:08.948356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b386b-0df8-40ce-bee1-81f5f3be60b8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:08.948641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b386b-0df8-40ce-bee1-81f5f3be60b8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:08.950592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 68/134] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:08.951150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b386b-0df8-40ce-bee1-81f5f3be60b8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:09.012792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:09.024501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3cde-b6fc-430a-b0c4-2207d2f95687 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:09.078823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac842517-0d0b-4263-ada1-8605b9d1440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:09.079824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842517-0d0b-4263-ada1-8605b9d1440a None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:09.080133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842517-0d0b-4263-ada1-8605b9d1440a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:09.080425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842517-0d0b-4263-ada1-8605b9d1440a None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206/users/dad84ac759bb44c09343109fa742afe2/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:09.088633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac842517-0d0b-4263-ada1-8605b9d1440a None admin] RBAC: Authorizing `identity:create_grant(project_id=b569a1d3ddb44429977459c3b6277206, user_id=dad84ac759bb44c09343109fa742afe2, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:09.090241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac842517-0d0b-4263-ada1-8605b9d1440a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:09.108900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:09.114586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 67/135] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:08 2022] PUT /identity/v3/projects/b569a1d3ddb44429977459c3b6277206/users/dad84ac759bb44c09343109fa742afe2/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:09.120091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be951-6b3e-439c-a46c-a895d31ce9b6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:09.120401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be951-6b3e-439c-a46c-a895d31ce9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:09.120682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be951-6b3e-439c-a46c-a895d31ce9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:09.164357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b26be951-6b3e-439c-a46c-a895d31ce9b6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:09.166120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b26be951-6b3e-439c-a46c-a895d31ce9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:09.224319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b386b-0df8-40ce-bee1-81f5f3be60b8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:09.313213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506077f-ae5b-4746-bd69-e48c94baf996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:09.314211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506077f-ae5b-4746-bd69-e48c94baf996 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:09.314510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506077f-ae5b-4746-bd69-e48c94baf996 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:09.314804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506077f-ae5b-4746-bd69-e48c94baf996 None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:09.317447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506077f-ae5b-4746-bd69-e48c94baf996 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:09.319040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506077f-ae5b-4746-bd69-e48c94baf996 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:09.327205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 69/136] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:08 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:09.328139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506077f-ae5b-4746-bd69-e48c94baf996 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:09.350260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 68/137] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:09.382771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26be951-6b3e-439c-a46c-a895d31ce9b6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:09.591510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506077f-ae5b-4746-bd69-e48c94baf996 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:09.601940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:09.627013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26be951-6b3e-439c-a46c-a895d31ce9b6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:09.658429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:09.669182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67359a5-1dc0-4825-8342-8c483f4d18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:09.671224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67359a5-1dc0-4825-8342-8c483f4d18e6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:09.671540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67359a5-1dc0-4825-8342-8c483f4d18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:09.671831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67359a5-1dc0-4825-8342-8c483f4d18e6 None admin] PATH_INFO: `/v3/projects/cd75671c84b74a99be960915cbc32257` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:09.677434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67359a5-1dc0-4825-8342-8c483f4d18e6 None admin] RBAC: Authorizing `identity:get_project(project_id=cd75671c84b74a99be960915cbc32257)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:09.679414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67359a5-1dc0-4825-8342-8c483f4d18e6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:09.681257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 70/138] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:09 2022] GET /identity/v3/projects/cd75671c84b74a99be960915cbc32257 => generated 312 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:09.689942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67359a5-1dc0-4825-8342-8c483f4d18e6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:09.722701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb2ba1-9fd6-41f9-8d63-67a84a197a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:09.723516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb2ba1-9fd6-41f9-8d63-67a84a197a94 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:09.723808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb2ba1-9fd6-41f9-8d63-67a84a197a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:09.724089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb2ba1-9fd6-41f9-8d63-67a84a197a94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:09.726164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb2ba1-9fd6-41f9-8d63-67a84a197a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:09.728188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb2ba1-9fd6-41f9-8d63-67a84a197a94 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:09.730157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 69/139] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:09.738235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb2ba1-9fd6-41f9-8d63-67a84a197a94 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:09.909270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67359a5-1dc0-4825-8342-8c483f4d18e6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:09.973469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c6414-bdf1-4b66-bfcd-f8295a490d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:09.974441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6414-bdf1-4b66-bfcd-f8295a490d55 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:09.974760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6414-bdf1-4b66-bfcd-f8295a490d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:09.975132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6414-bdf1-4b66-bfcd-f8295a490d55 None admin] PATH_INFO: `/v3/projects/cd75671c84b74a99be960915cbc32257/users/6d4c968bc8d646f3a5194fd6e06e5dc4/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:09.977654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c6414-bdf1-4b66-bfcd-f8295a490d55 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd75671c84b74a99be960915cbc32257, user_id=6d4c968bc8d646f3a5194fd6e06e5dc4, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:09.979291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c6414-bdf1-4b66-bfcd-f8295a490d55 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:09.980217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb2ba1-9fd6-41f9-8d63-67a84a197a94 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:10.002317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 71/140] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:09 2022] PUT /identity/v3/projects/cd75671c84b74a99be960915cbc32257/users/6d4c968bc8d646f3a5194fd6e06e5dc4/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:45:10.048280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00658b-ac2e-4baf-b566-96d988854179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:10.049428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00658b-ac2e-4baf-b566-96d988854179 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:10.050041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00658b-ac2e-4baf-b566-96d988854179 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:10.050567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00658b-ac2e-4baf-b566-96d988854179 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:10.051576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00658b-ac2e-4baf-b566-96d988854179 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:10.053370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00658b-ac2e-4baf-b566-96d988854179 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:10.083781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 70/141] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:09 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:11.326061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d89a-4c7e-4b9b-b242-a9e27d6c590f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:11.326587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d89a-4c7e-4b9b-b242-a9e27d6c590f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:11.326661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d89a-4c7e-4b9b-b242-a9e27d6c590f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:11.328006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 72/142] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:11.341570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bb393-e59b-4560-b960-1154137b8d2b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:11.342059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bb393-e59b-4560-b960-1154137b8d2b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:11.342252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bb393-e59b-4560-b960-1154137b8d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:11.365933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3f6bb393-e59b-4560-b960-1154137b8d2b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:11.367908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3f6bb393-e59b-4560-b960-1154137b8d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:11.372159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:11.456637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 71/143] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:11.489611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d89a-4c7e-4b9b-b242-a9e27d6c590f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:11.568201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:11.629325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d89a-4c7e-4b9b-b242-a9e27d6c590f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:11.674149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28af1da-3abc-4859-9739-b5e587d76290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:11.675142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af1da-3abc-4859-9739-b5e587d76290 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:11.675439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af1da-3abc-4859-9739-b5e587d76290 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:11.675721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af1da-3abc-4859-9739-b5e587d76290 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:11.687853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28af1da-3abc-4859-9739-b5e587d76290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d28af1da-3abc-4859-9739-b5e587d76290 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:11.696379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:11.697526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:11.698456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:11.701713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 73/144] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:11.708309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bb393-e59b-4560-b960-1154137b8d2b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:11.828293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bb393-e59b-4560-b960-1154137b8d2b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:11.867507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:11.868189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:11.868472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:11.868749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:11.869510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:11.869840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:11.871229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:11.884440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 72/145] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:11.890887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28af1da-3abc-4859-9739-b5e587d76290 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:12.024635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28af1da-3abc-4859-9739-b5e587d76290 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:12.047058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:12.071853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce649e-3e59-4dad-bcf4-3a67abfc0be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:12.073032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce649e-3e59-4dad-bcf4-3a67abfc0be8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:12.073575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce649e-3e59-4dad-bcf4-3a67abfc0be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:12.074074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce649e-3e59-4dad-bcf4-3a67abfc0be8 None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:12.078402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce649e-3e59-4dad-bcf4-3a67abfc0be8 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:12.079904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce649e-3e59-4dad-bcf4-3a67abfc0be8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:12.081745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 74/146] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:11 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:12.090181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:12.093631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:12.274984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d07d5e-48f4-4d6a-9f63-7fca6387bdda None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:12.323156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99dd0a-3e6b-42f2-a561-6d0f9e298741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:12.323843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99dd0a-3e6b-42f2-a561-6d0f9e298741 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:12.324139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99dd0a-3e6b-42f2-a561-6d0f9e298741 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:12.324462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99dd0a-3e6b-42f2-a561-6d0f9e298741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:12.433414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99dd0a-3e6b-42f2-a561-6d0f9e298741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:12.434967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99dd0a-3e6b-42f2-a561-6d0f9e298741 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:12.438021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:12.490773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7408-443f-44e8-b074-fd2d8c3ff53c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:12.491858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7408-443f-44e8-b074-fd2d8c3ff53c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:12.491858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7408-443f-44e8-b074-fd2d8c3ff53c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:12.493229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 75/147] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:12.498955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e375a84-d0e1-4fcb-a8b5-dd93f83b97d4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:12.499256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e375a84-d0e1-4fcb-a8b5-dd93f83b97d4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:12.499550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e375a84-d0e1-4fcb-a8b5-dd93f83b97d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:12.538313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8e375a84-d0e1-4fcb-a8b5-dd93f83b97d4 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:12.539485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8e375a84-d0e1-4fcb-a8b5-dd93f83b97d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:12.636234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 73/148] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:12.642610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99dd0a-3e6b-42f2-a561-6d0f9e298741 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:12.715735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 76/149] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:12.763002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e375a84-d0e1-4fcb-a8b5-dd93f83b97d4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:12.928909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99dd0a-3e6b-42f2-a561-6d0f9e298741 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:12.937946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:12.986476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e0d1c-dac3-465f-b43a-75ce77eb3a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:12.987366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e0d1c-dac3-465f-b43a-75ce77eb3a5a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:12.987655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e0d1c-dac3-465f-b43a-75ce77eb3a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:12.987934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e0d1c-dac3-465f-b43a-75ce77eb3a5a None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:12.989390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e0d1c-dac3-465f-b43a-75ce77eb3a5a None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:12.991973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e0d1c-dac3-465f-b43a-75ce77eb3a5a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:12.994251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 74/150] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:12 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:13.002092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dd679-a851-406b-a423-6901709c0ccc None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:13.002437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dd679-a851-406b-a423-6901709c0ccc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:13.002731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dd679-a851-406b-a423-6901709c0ccc None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:13.004546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 75/151] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:13.005369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dd679-a851-406b-a423-6901709c0ccc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:13.063872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e375a84-d0e1-4fcb-a8b5-dd93f83b97d4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:13.102017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:13.158284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8657c88-70b3-42a7-820e-dfcd17752483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:13.159113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8657c88-70b3-42a7-820e-dfcd17752483 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:13.159407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8657c88-70b3-42a7-820e-dfcd17752483 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:13.159692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8657c88-70b3-42a7-820e-dfcd17752483 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:13.188721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8657c88-70b3-42a7-820e-dfcd17752483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c8657c88-70b3-42a7-820e-dfcd17752483 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:13.200934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:13.201877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:13.202643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 77/152] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:13.203806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3062a5-d5e9-4aff-a62f-04ff73bec41b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:13.204051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3062a5-d5e9-4aff-a62f-04ff73bec41b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:13.204337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3062a5-d5e9-4aff-a62f-04ff73bec41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:13.237922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ae3062a5-d5e9-4aff-a62f-04ff73bec41b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:13.239181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae3062a5-d5e9-4aff-a62f-04ff73bec41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:13.290803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dd679-a851-406b-a423-6901709c0ccc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:13.326579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 78/153] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:13.328279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c80dd7-fd6e-42d8-a3af-fc425808080a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:13.328581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c80dd7-fd6e-42d8-a3af-fc425808080a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:13.328883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c80dd7-fd6e-42d8-a3af-fc425808080a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:13.330265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 79/154] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:13.331050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c80dd7-fd6e-42d8-a3af-fc425808080a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:13.394821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0a31-32ac-4274-9ebe-04e7a5076112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:13.395876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0a31-32ac-4274-9ebe-04e7a5076112 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:13.396429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0a31-32ac-4274-9ebe-04e7a5076112 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:13.397429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0a31-32ac-4274-9ebe-04e7a5076112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:13.398574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c0a31-32ac-4274-9ebe-04e7a5076112 None admin] RBAC: Adding query filter params (role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=b569a1d3ddb44429977459c3b6277206, user.id=6d4c968bc8d646f3a5194fd6e06e5dc4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:13.399086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c0a31-32ac-4274-9ebe-04e7a5076112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:13.400820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c0a31-32ac-4274-9ebe-04e7a5076112 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:13.413139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 76/155] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:13 2022] GET /identity/v3/role_assignments?user.id=6d4c968bc8d646f3a5194fd6e06e5dc4&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 608 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:13.414943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7d2fc-782e-4b46-8dcf-a4221a02fd79 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:13.415450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7d2fc-782e-4b46-8dcf-a4221a02fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:13.415924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7d2fc-782e-4b46-8dcf-a4221a02fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:13.462832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-76b7d2fc-782e-4b46-8dcf-a4221a02fd79 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:13.464891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-76b7d2fc-782e-4b46-8dcf-a4221a02fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:13.541693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c80dd7-fd6e-42d8-a3af-fc425808080a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:13.550125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:13.559719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:13.620633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:13.621786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:13.622785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:13.623424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:13.624869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:13.625376 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:13.629584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:13.640736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 80/156] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:13.641782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:13.680272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 77/157] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:13.681612 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7d2fc-782e-4b46-8dcf-a4221a02fd79 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:13.778797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0d8dd-b27c-4524-957a-a9a64ab86532 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:13.823395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfdfcf-8b23-474d-a00e-9f49c9692663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:13.824236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdfcf-8b23-474d-a00e-9f49c9692663 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:13.824530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdfcf-8b23-474d-a00e-9f49c9692663 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:13.824817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdfcf-8b23-474d-a00e-9f49c9692663 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:13.844493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfdfcf-8b23-474d-a00e-9f49c9692663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-eecfdfcf-8b23-474d-a00e-9f49c9692663 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:13.857948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:13.858974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:13.859840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 81/158] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:13.860612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfdfcf-8b23-474d-a00e-9f49c9692663 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:13.926962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:13.974737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7d2fc-782e-4b46-8dcf-a4221a02fd79 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:14.081209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea500b-8765-45fa-a286-39cb6f502e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:14.082561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea500b-8765-45fa-a286-39cb6f502e44 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:14.083049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea500b-8765-45fa-a286-39cb6f502e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:14.083527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea500b-8765-45fa-a286-39cb6f502e44 None admin] PATH_INFO: `/v3/users/40bd204757d842c4a12a7f599b58fc6b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:14.086377 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea500b-8765-45fa-a286-39cb6f502e44 None admin] RBAC: Authorizing `identity:get_user(user_id=40bd204757d842c4a12a7f599b58fc6b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:14.088171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea500b-8765-45fa-a286-39cb6f502e44 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:14.090286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 78/159] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:13 2022] GET /identity/v3/users/40bd204757d842c4a12a7f599b58fc6b => generated 289 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:14.091262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea500b-8765-45fa-a286-39cb6f502e44 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:14.104905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfdfcf-8b23-474d-a00e-9f49c9692663 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:14.194325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:14.198345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511de32-eea9-416a-b50b-f05a91a305f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:14.199193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511de32-eea9-416a-b50b-f05a91a305f9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:14.199490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511de32-eea9-416a-b50b-f05a91a305f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:14.199777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511de32-eea9-416a-b50b-f05a91a305f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:14.223058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511de32-eea9-416a-b50b-f05a91a305f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4511de32-eea9-416a-b50b-f05a91a305f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:14.232024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:14.233149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:14.233951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:14.242265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 82/160] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:14.243249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511de32-eea9-416a-b50b-f05a91a305f9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:14.394859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea500b-8765-45fa-a286-39cb6f502e44 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:14.451800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:14.452492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:14.452779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:14.453060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:14.453870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:14.454184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:14.455619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:14.475849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 79/161] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:14.477299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:14.477465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:14.511628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511de32-eea9-416a-b50b-f05a91a305f9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:14.579617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7b29-9111-4275-a905-75ca44ae43d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:14.580501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7b29-9111-4275-a905-75ca44ae43d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:14.580792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7b29-9111-4275-a905-75ca44ae43d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:14.581077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7b29-9111-4275-a905-75ca44ae43d0 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:14.582621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f7b29-9111-4275-a905-75ca44ae43d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:14.586356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f7b29-9111-4275-a905-75ca44ae43d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:14.588386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 83/162] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:14 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:14.590122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7b29-9111-4275-a905-75ca44ae43d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:14.697080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:14.711188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5aa9af-6ced-4555-b551-669c1f38d057 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:14.779175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03530ac-3cd6-4188-8ba4-2146365064c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:14.779937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03530ac-3cd6-4188-8ba4-2146365064c1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:14.780232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03530ac-3cd6-4188-8ba4-2146365064c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:14.780518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03530ac-3cd6-4188-8ba4-2146365064c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:14.781354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03530ac-3cd6-4188-8ba4-2146365064c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:14.781702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03530ac-3cd6-4188-8ba4-2146365064c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:14.784233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7b29-9111-4275-a905-75ca44ae43d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:14.785797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03530ac-3cd6-4188-8ba4-2146365064c1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:14.806681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 80/163] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:14.809631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100200b1-7e59-45f8-89a1-a357bea6d6e3 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:14.809937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100200b1-7e59-45f8-89a1-a357bea6d6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:14.810226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100200b1-7e59-45f8-89a1-a357bea6d6e3 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:14.811671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 81/164] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:14.812378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100200b1-7e59-45f8-89a1-a357bea6d6e3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:14.861080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8189-51da-479e-9133-983064473405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:14.862009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8189-51da-479e-9133-983064473405 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:14.862302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8189-51da-479e-9133-983064473405 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:14.862590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8189-51da-479e-9133-983064473405 None admin] PATH_INFO: `/v3/users/dad84ac759bb44c09343109fa742afe2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:14.863948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca8189-51da-479e-9133-983064473405 None admin] RBAC: Authorizing `identity:get_user(user_id=dad84ac759bb44c09343109fa742afe2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:14.865697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca8189-51da-479e-9133-983064473405 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:14.868427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 84/165] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:14 2022] GET /identity/v3/users/dad84ac759bb44c09343109fa742afe2 => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:14.868588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8189-51da-479e-9133-983064473405 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:14.908003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:14.982003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100200b1-7e59-45f8-89a1-a357bea6d6e3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:15.012421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8189-51da-479e-9133-983064473405 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:15.029162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646db173-b926-4d18-b606-f53bf62bec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:15.031230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db173-b926-4d18-b606-f53bf62bec91 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.031777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db173-b926-4d18-b606-f53bf62bec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.032648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db173-b926-4d18-b606-f53bf62bec91 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206/users/40bd204757d842c4a12a7f599b58fc6b/roles/c55bd507a50c4e61b27c205ea173975b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.036104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646db173-b926-4d18-b606-f53bf62bec91 None admin] RBAC: Authorizing `identity:create_grant(project_id=b569a1d3ddb44429977459c3b6277206, user_id=40bd204757d842c4a12a7f599b58fc6b, role_id=c55bd507a50c4e61b27c205ea173975b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:15.038682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646db173-b926-4d18-b606-f53bf62bec91 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:15.055803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28526703-5648-4e59-9f7f-25ea16e44dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:15.057133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526703-5648-4e59-9f7f-25ea16e44dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.057717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526703-5648-4e59-9f7f-25ea16e44dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.058239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 82/166] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:14 2022] PUT /identity/v3/projects/b569a1d3ddb44429977459c3b6277206/users/40bd204757d842c4a12a7f599b58fc6b/roles/c55bd507a50c4e61b27c205ea173975b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:15.058420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526703-5648-4e59-9f7f-25ea16e44dc9 None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.059897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05736-4931-441b-9f3a-99782fc87f8b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.060260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05736-4931-441b-9f3a-99782fc87f8b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.060369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28526703-5648-4e59-9f7f-25ea16e44dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:15.060656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05736-4931-441b-9f3a-99782fc87f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.062445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28526703-5648-4e59-9f7f-25ea16e44dc9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:15.064597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 85/167] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:14 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:15.066358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d7ce-a0ad-41c7-8be5-9ecaffc78162 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.066983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d7ce-a0ad-41c7-8be5-9ecaffc78162 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.067467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d7ce-a0ad-41c7-8be5-9ecaffc78162 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.069908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 86/168] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:15.075275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d7ce-a0ad-41c7-8be5-9ecaffc78162 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:15.082044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6ed05736-4931-441b-9f3a-99782fc87f8b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:15.083365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6ed05736-4931-441b-9f3a-99782fc87f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:15.098717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:15.183693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 83/169] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:15.184781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05736-4931-441b-9f3a-99782fc87f8b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:15.226256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:15.247939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d7ce-a0ad-41c7-8be5-9ecaffc78162 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:15.297085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2c52-07d4-4dfe-a021-e8187c32a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:15.298198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2c52-07d4-4dfe-a021-e8187c32a6ff None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.300158 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2c52-07d4-4dfe-a021-e8187c32a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.300909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2c52-07d4-4dfe-a021-e8187c32a6ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.422862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05736-4931-441b-9f3a-99782fc87f8b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:15.457213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2c52-07d4-4dfe-a021-e8187c32a6ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:15.460877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2c52-07d4-4dfe-a021-e8187c32a6ff None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:15.464624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715bf4b-a2cd-4470-970a-03d00ede6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:15.465465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715bf4b-a2cd-4470-970a-03d00ede6721 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.465914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715bf4b-a2cd-4470-970a-03d00ede6721 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.466403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715bf4b-a2cd-4470-970a-03d00ede6721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.487052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:15.561315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715bf4b-a2cd-4470-970a-03d00ede6721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:15.563076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715bf4b-a2cd-4470-970a-03d00ede6721 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:15.604418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:15.614579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 87/170] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:15.616255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15315dd-6b78-44d3-b330-4bd6f068884c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.616973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15315dd-6b78-44d3-b330-4bd6f068884c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.617271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15315dd-6b78-44d3-b330-4bd6f068884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.639936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b15315dd-6b78-44d3-b330-4bd6f068884c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:15.641173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b15315dd-6b78-44d3-b330-4bd6f068884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:15.695525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 84/171] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:15.696399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715bf4b-a2cd-4470-970a-03d00ede6721 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:15.724161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 88/172] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:15.724161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259067-5816-4863-96c3-6039eb1e17c7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.724161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259067-5816-4863-96c3-6039eb1e17c7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.724161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259067-5816-4863-96c3-6039eb1e17c7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.724161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 89/173] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:15.724656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259067-5816-4863-96c3-6039eb1e17c7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:15.773647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:15.846167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715bf4b-a2cd-4470-970a-03d00ede6721 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:15.858351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259067-5816-4863-96c3-6039eb1e17c7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:15.884099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91157744-ffbf-4e74-8470-f0a411160d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:15.884935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91157744-ffbf-4e74-8470-f0a411160d28 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.885193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91157744-ffbf-4e74-8470-f0a411160d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.885465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91157744-ffbf-4e74-8470-f0a411160d28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.888254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:15.900083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91157744-ffbf-4e74-8470-f0a411160d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:15.906516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533fae6-2228-4330-85a7-48916f18d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:15.907963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533fae6-2228-4330-85a7-48916f18d68c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-91157744-ffbf-4e74-8470-f0a411160d28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:15.908133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:15.908992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:15.915784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:15.916389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533fae6-2228-4330-85a7-48916f18d68c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.916389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533fae6-2228-4330-85a7-48916f18d68c None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.916596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 85/174] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:15.916596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4edc-af40-4e9e-a7e3-58c3f27c0e45 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.916596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4edc-af40-4e9e-a7e3-58c3f27c0e45 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.916596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4edc-af40-4e9e-a7e3-58c3f27c0e45 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.916596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 86/175] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:15.916596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4edc-af40-4e9e-a7e3-58c3f27c0e45 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:15.916919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533fae6-2228-4330-85a7-48916f18d68c None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:15.917846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533fae6-2228-4330-85a7-48916f18d68c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:15.921647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 90/176] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:15 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:15.921647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6f76-11e3-45c6-9299-85abca73096c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:15.921647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6f76-11e3-45c6-9299-85abca73096c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:15.921647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6f76-11e3-45c6-9299-85abca73096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:15.938160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bf7d6f76-11e3-45c6-9299-85abca73096c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:15.939358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf7d6f76-11e3-45c6-9299-85abca73096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:16.015883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 91/177] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:16.016743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d6f76-11e3-45c6-9299-85abca73096c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.045370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4edc-af40-4e9e-a7e3-58c3f27c0e45 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.054057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:16.083516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502f276-d4e2-4767-abe2-d6b294ffac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:16.084446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f276-d4e2-4767-abe2-d6b294ffac3e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.084737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f276-d4e2-4767-abe2-d6b294ffac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.085009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f276-d4e2-4767-abe2-d6b294ffac3e None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.086213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502f276-d4e2-4767-abe2-d6b294ffac3e None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:16.087668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502f276-d4e2-4767-abe2-d6b294ffac3e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:16.089910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 87/178] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:15 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:16.095362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512892-8a13-4bea-b671-dc30b08eaaaa None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.095668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512892-8a13-4bea-b671-dc30b08eaaaa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.095953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512892-8a13-4bea-b671-dc30b08eaaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.113463 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ca512892-8a13-4bea-b671-dc30b08eaaaa None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:16.114841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ca512892-8a13-4bea-b671-dc30b08eaaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:16.132826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d6f76-11e3-45c6-9299-85abca73096c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.157358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:16.177107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52847c-3099-4ef0-8191-fb346a18510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:16.178377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52847c-3099-4ef0-8191-fb346a18510b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.178789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52847c-3099-4ef0-8191-fb346a18510b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.179285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52847c-3099-4ef0-8191-fb346a18510b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.190944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52847c-3099-4ef0-8191-fb346a18510b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5f52847c-3099-4ef0-8191-fb346a18510b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:16.199991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:16.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 92/179] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:16.205676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52847c-3099-4ef0-8191-fb346a18510b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.217933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 88/180] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:16.218806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca512892-8a13-4bea-b671-dc30b08eaaaa None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.345415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52847c-3099-4ef0-8191-fb346a18510b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.346422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca512892-8a13-4bea-b671-dc30b08eaaaa None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.351246 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:16.381609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:16.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.382568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.382851 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.383639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:16.383953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:16.385345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:16.389129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:16.390000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.390887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.391299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.392568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=b569a1d3ddb44429977459c3b6277206, user.id=dad84ac759bb44c09343109fa742afe2) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:16.393030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:16.393754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 93/181] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:16.399328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.400194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:16.409585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 89/182] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/role_assignments?user.id=dad84ac759bb44c09343109fa742afe2&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:16.411116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.485243 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:16.553031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5049ffb-3544-4682-a251-83ab000c4726 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.570397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc906c-361f-4d80-b9cb-8847644aeffd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.608127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:16.609179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.609490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.609906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.610886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] RBAC: Adding query filter params (role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=b569a1d3ddb44429977459c3b6277206, user.id=6d4c968bc8d646f3a5194fd6e06e5dc4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:16.611321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:16.612891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:16.615144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c067d7e-e735-4ae3-9e5b-5edc7c0ffb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:16.617261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067d7e-e735-4ae3-9e5b-5edc7c0ffb80 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.617730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067d7e-e735-4ae3-9e5b-5edc7c0ffb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.618149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067d7e-e735-4ae3-9e5b-5edc7c0ffb80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.622026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 90/183] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/role_assignments?user.id=6d4c968bc8d646f3a5194fd6e06e5dc4&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=025cadb68d6641098d3edb9e47910aaf => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:16.623633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.641233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c067d7e-e735-4ae3-9e5b-5edc7c0ffb80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2c067d7e-e735-4ae3-9e5b-5edc7c0ffb80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:16.655825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:16.656767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:16.657530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 94/184] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:16.659155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c067d7e-e735-4ae3-9e5b-5edc7c0ffb80 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.682208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:16.779252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ee818-f9be-4f8b-ba89-6467b63a2e0c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.801102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c067d7e-e735-4ae3-9e5b-5edc7c0ffb80 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.803092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:16.823227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:16.824125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.824518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.824918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.825839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:16.826317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:16.828220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:16.838895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 91/185] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:16.839752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.849844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96785-6874-4dda-8d99-8a02b4c6a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:16.850931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96785-6874-4dda-8d99-8a02b4c6a9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:16.851382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96785-6874-4dda-8d99-8a02b4c6a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:16.851806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96785-6874-4dda-8d99-8a02b4c6a9b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:16.854374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de96785-6874-4dda-8d99-8a02b4c6a9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:16.856036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de96785-6874-4dda-8d99-8a02b4c6a9b9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:16.857943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 95/186] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:16.858898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96785-6874-4dda-8d99-8a02b4c6a9b9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:16.950882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:16.962351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a010f33-dc20-4f46-8904-bd25cfd8f729 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:16.988822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96785-6874-4dda-8d99-8a02b4c6a9b9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:17.008308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80a4f-2736-4966-a360-7934c5562a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:17.009512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80a4f-2736-4966-a360-7934c5562a06 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:17.009833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80a4f-2736-4966-a360-7934c5562a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:17.010117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80a4f-2736-4966-a360-7934c5562a06 None admin] PATH_INFO: `/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:17.011364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e80a4f-2736-4966-a360-7934c5562a06 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4c968bc8d646f3a5194fd6e06e5dc4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:17.012820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e80a4f-2736-4966-a360-7934c5562a06 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:17.017835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 92/187] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/users/6d4c968bc8d646f3a5194fd6e06e5dc4 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:17.017835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80a4f-2736-4966-a360-7934c5562a06 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:17.039706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:17.040665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:17.040956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:17.041385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:17.042480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:17.042979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:17.044367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:17.058544 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 96/188] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:17.058544 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:17.090203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:17.137049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80a4f-2736-4966-a360-7934c5562a06 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:17.170216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ce582-2e9c-48d0-bb47-361246e40e69 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:17.174521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4867f-22c7-4d28-91dd-90b0a06743d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:17.175599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4867f-22c7-4d28-91dd-90b0a06743d3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:17.176140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4867f-22c7-4d28-91dd-90b0a06743d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:17.176563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4867f-22c7-4d28-91dd-90b0a06743d3 None admin] PATH_INFO: `/v3/users/dfa654c5773d44a6bd732131d50b2d58` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:17.194781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4867f-22c7-4d28-91dd-90b0a06743d3 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa654c5773d44a6bd732131d50b2d58)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:17.196492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4867f-22c7-4d28-91dd-90b0a06743d3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:17.198291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 93/189] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:17 2022] GET /identity/v3/users/dfa654c5773d44a6bd732131d50b2d58 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:17.199066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4867f-22c7-4d28-91dd-90b0a06743d3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:17.215288 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e24a2-5446-41eb-a520-7bca49067353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:17.215905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e24a2-5446-41eb-a520-7bca49067353 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:17.216196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e24a2-5446-41eb-a520-7bca49067353 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:17.216478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e24a2-5446-41eb-a520-7bca49067353 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:17.217199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e24a2-5446-41eb-a520-7bca49067353 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:17.218696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e24a2-5446-41eb-a520-7bca49067353 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:17.223215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:17.242774 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 97/190] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:17 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:17.243971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e24a2-5446-41eb-a520-7bca49067353 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:17.328449 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4867f-22c7-4d28-91dd-90b0a06743d3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:17.371931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc59bf-adae-431b-b157-c7e13bfdb2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:17.372688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc59bf-adae-431b-b157-c7e13bfdb2aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:17.373003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc59bf-adae-431b-b157-c7e13bfdb2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:17.373290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc59bf-adae-431b-b157-c7e13bfdb2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:17.388264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:17.409569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e24a2-5446-41eb-a520-7bca49067353 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:17.451729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4e736-08e0-436b-ab32-428a4b320a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:17.452757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e736-08e0-436b-ab32-428a4b320a40 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:17.453023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e736-08e0-436b-ab32-428a4b320a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:17.453334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e736-08e0-436b-ab32-428a4b320a40 None admin] PATH_INFO: `/v3/users/dfa654c5773d44a6bd732131d50b2d58` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:17.454710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4e736-08e0-436b-ab32-428a4b320a40 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa654c5773d44a6bd732131d50b2d58)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:17.456352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4e736-08e0-436b-ab32-428a4b320a40 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:17.457989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 98/191] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:17 2022] GET /identity/v3/users/dfa654c5773d44a6bd732131d50b2d58 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:17.462596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4e736-08e0-436b-ab32-428a4b320a40 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:17.482111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc59bf-adae-431b-b157-c7e13bfdb2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:17.484586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc59bf-adae-431b-b157-c7e13bfdb2aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:17.509476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:17.596283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4e736-08e0-436b-ab32-428a4b320a40 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:17.618557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 94/192] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:17.619250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc59bf-adae-431b-b157-c7e13bfdb2aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:17.646014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f746-14ca-4011-8863-5b9e437ad792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:17.647201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f746-14ca-4011-8863-5b9e437ad792 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:17.647831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f746-14ca-4011-8863-5b9e437ad792 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:17.647831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f746-14ca-4011-8863-5b9e437ad792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:17.696457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:17.752937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f746-14ca-4011-8863-5b9e437ad792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:17.754584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f746-14ca-4011-8863-5b9e437ad792 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:17.765862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc59bf-adae-431b-b157-c7e13bfdb2aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:17.789983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:17.804331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e62d1c-3ccf-4568-a1f9-82385b109ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:17.805192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e62d1c-3ccf-4568-a1f9-82385b109ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:17.805611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e62d1c-3ccf-4568-a1f9-82385b109ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:17.805994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e62d1c-3ccf-4568-a1f9-82385b109ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:17.887960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 99/193] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:17.889450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e62d1c-3ccf-4568-a1f9-82385b109ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:17.890875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f746-14ca-4011-8863-5b9e437ad792 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:17.891182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e62d1c-3ccf-4568-a1f9-82385b109ca6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:17.964422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:18.020009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f746-14ca-4011-8863-5b9e437ad792 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:18.029345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 95/194] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:18.030875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63a1f-1ec5-40a0-8d71-9497b1f0b59d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.031281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63a1f-1ec5-40a0-8d71-9497b1f0b59d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.031627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63a1f-1ec5-40a0-8d71-9497b1f0b59d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.034055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 96/195] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:18.035021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a63a1f-1ec5-40a0-8d71-9497b1f0b59d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:18.066272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfde1b-fadb-411f-81d5-fbc33f88d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:18.066928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:18.067181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfde1b-fadb-411f-81d5-fbc33f88d95d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.067470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfde1b-fadb-411f-81d5-fbc33f88d95d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.067751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfde1b-fadb-411f-81d5-fbc33f88d95d None admin] PATH_INFO: `/v3/projects/cd75671c84b74a99be960915cbc32257` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.069373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfde1b-fadb-411f-81d5-fbc33f88d95d None admin] RBAC: Authorizing `identity:get_project(project_id=cd75671c84b74a99be960915cbc32257)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:18.071043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfde1b-fadb-411f-81d5-fbc33f88d95d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:18.073161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 100/196] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:17 2022] GET /identity/v3/projects/cd75671c84b74a99be960915cbc32257 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:18.078388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfde1b-fadb-411f-81d5-fbc33f88d95d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:18.183289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a63a1f-1ec5-40a0-8d71-9497b1f0b59d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:18.185000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfde1b-fadb-411f-81d5-fbc33f88d95d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:18.214127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:18.227375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ce13e-edd6-45b4-9586-4f9de9e46415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:18.228266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ce13e-edd6-45b4-9586-4f9de9e46415 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.228533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ce13e-edd6-45b4-9586-4f9de9e46415 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.228817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ce13e-edd6-45b4-9586-4f9de9e46415 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.229643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92996f3-4c76-4d57-8cfe-7760b75971de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:18.230170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ce13e-edd6-45b4-9586-4f9de9e46415 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:18.230974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92996f3-4c76-4d57-8cfe-7760b75971de None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.231461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92996f3-4c76-4d57-8cfe-7760b75971de None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.231645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ce13e-edd6-45b4-9586-4f9de9e46415 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:18.232120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92996f3-4c76-4d57-8cfe-7760b75971de None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.233342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 97/197] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:18 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:18.233809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92996f3-4c76-4d57-8cfe-7760b75971de None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:18.234538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7861-dffa-447c-868a-959455560940 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.234828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7861-dffa-447c-868a-959455560940 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.235110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7861-dffa-447c-868a-959455560940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.236171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92996f3-4c76-4d57-8cfe-7760b75971de None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:18.238713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 101/198] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:18 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:18.239812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92996f3-4c76-4d57-8cfe-7760b75971de None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:18.253899 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ab2e7861-dffa-447c-868a-959455560940 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:18.255290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ab2e7861-dffa-447c-868a-959455560940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:18.330120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 98/199] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:18.331081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e7861-dffa-447c-868a-959455560940 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:18.351446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:18.395489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92996f3-4c76-4d57-8cfe-7760b75971de None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:18.442426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:18.444287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.444657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.445014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.446102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] RBAC: Adding query filter params (role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=cd75671c84b74a99be960915cbc32257, user.id=6d4c968bc8d646f3a5194fd6e06e5dc4) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:18.446735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:18.449442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:18.461306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e7861-dffa-447c-868a-959455560940 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:18.465647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 102/200] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:18 2022] GET /identity/v3/role_assignments?user.id=6d4c968bc8d646f3a5194fd6e06e5dc4&scope.project.id=cd75671c84b74a99be960915cbc32257&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:18.467641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:18.543388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:18.546347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.546893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.547405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.551378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9, user.id=dfa654c5773d44a6bd732131d50b2d58) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:18.552031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:18.555272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:18.568923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 99/201] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:18 2022] GET /identity/v3/role_assignments?user.id=dfa654c5773d44a6bd732131d50b2d58&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:18.572269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:18.594353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:18.647371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919701fd-2322-43bf-914c-c0c4d40cfb89 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:18.695267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:18.695964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.696254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.696540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.697404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] RBAC: Adding query filter params (role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9, user.id=dfa654c5773d44a6bd732131d50b2d58) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:18.697757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:18.700083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:18.707468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 103/202] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:18 2022] GET /identity/v3/role_assignments?user.id=dfa654c5773d44a6bd732131d50b2d58&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=025cadb68d6641098d3edb9e47910aaf => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:18.782675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:18.806747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938df54-a9dd-4991-8d26-ebdc61cff1a2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:18.858514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a96e57-ca9a-469c-9f9f-3bdc12933f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:18.859253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96e57-ca9a-469c-9f9f-3bdc12933f77 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:18.859542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96e57-ca9a-469c-9f9f-3bdc12933f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:18.859824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96e57-ca9a-469c-9f9f-3bdc12933f77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:18.874004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a96e57-ca9a-469c-9f9f-3bdc12933f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b3a96e57-ca9a-469c-9f9f-3bdc12933f77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:18.882793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:18.883748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:18.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 100/203] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:18.894535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:19.030982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b854ed-bb1e-40bb-a817-01ad3bf7df29 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:19.057232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:19.081023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:19.081743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:19.082036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:19.082322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:19.083093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:19.083403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:19.084905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:19.093909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 104/204] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:19.100534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a96e57-ca9a-469c-9f9f-3bdc12933f77 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:19.248145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a96e57-ca9a-469c-9f9f-3bdc12933f77 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:19.293100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc20ac-9321-42d0-a99d-8b52c08e5196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:19.294383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc20ac-9321-42d0-a99d-8b52c08e5196 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:19.294899 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc20ac-9321-42d0-a99d-8b52c08e5196 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:19.295391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc20ac-9321-42d0-a99d-8b52c08e5196 None admin] PATH_INFO: `/v3/users/40bd204757d842c4a12a7f599b58fc6b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:19.296846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc20ac-9321-42d0-a99d-8b52c08e5196 None admin] RBAC: Authorizing `identity:get_user(user_id=40bd204757d842c4a12a7f599b58fc6b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:19.298546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc20ac-9321-42d0-a99d-8b52c08e5196 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:19.300465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 101/205] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:19 2022] GET /identity/v3/users/40bd204757d842c4a12a7f599b58fc6b => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:19.306249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:19.450018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254504-6c30-4123-af22-1011815a60f5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:19.493683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588702b7-8900-4f55-93ea-e3e8b7a8f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:19.494379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588702b7-8900-4f55-93ea-e3e8b7a8f958 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:19.494671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588702b7-8900-4f55-93ea-e3e8b7a8f958 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:19.494962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588702b7-8900-4f55-93ea-e3e8b7a8f958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:19.572166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:19.594554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588702b7-8900-4f55-93ea-e3e8b7a8f958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:19.596174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588702b7-8900-4f55-93ea-e3e8b7a8f958 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:19.730225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 105/206] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:19.738702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc20ac-9321-42d0-a99d-8b52c08e5196 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:19.759280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:19.887489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc20ac-9321-42d0-a99d-8b52c08e5196 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:19.930849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba3b65-ff6e-436a-8da0-fc365ab1dfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:19.931732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3b65-ff6e-436a-8da0-fc365ab1dfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:19.932021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3b65-ff6e-436a-8da0-fc365ab1dfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:19.932305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3b65-ff6e-436a-8da0-fc365ab1dfa7 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:19.938346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba3b65-ff6e-436a-8da0-fc365ab1dfa7 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:19.939845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba3b65-ff6e-436a-8da0-fc365ab1dfa7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:19.942015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 102/207] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:19 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:19.948195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588702b7-8900-4f55-93ea-e3e8b7a8f958 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:20.072352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:20.100298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588702b7-8900-4f55-93ea-e3e8b7a8f958 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:20.134508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a2bb-15cc-4d16-8eb2-a5069509f722 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.134810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a2bb-15cc-4d16-8eb2-a5069509f722 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.135063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a2bb-15cc-4d16-8eb2-a5069509f722 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.138062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 103/208] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:20.142037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b33fbd-3eb1-4510-b35b-e5509e3f27ff None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.142330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b33fbd-3eb1-4510-b35b-e5509e3f27ff None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.142614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b33fbd-3eb1-4510-b35b-e5509e3f27ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.148003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7029-d84c-4f17-a139-d7959f920646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:20.148809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7029-d84c-4f17-a139-d7959f920646 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.149102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7029-d84c-4f17-a139-d7959f920646 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.149510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7029-d84c-4f17-a139-d7959f920646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.150386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7029-d84c-4f17-a139-d7959f920646 None admin] RBAC: Adding query filter params (role.id=c55bd507a50c4e61b27c205ea173975b, scope.project.id=b569a1d3ddb44429977459c3b6277206, user.id=40bd204757d842c4a12a7f599b58fc6b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:20.150710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7029-d84c-4f17-a139-d7959f920646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:20.152170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7029-d84c-4f17-a139-d7959f920646 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:20.158432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 106/209] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:19 2022] GET /identity/v3/role_assignments?user.id=40bd204757d842c4a12a7f599b58fc6b&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=c55bd507a50c4e61b27c205ea173975b => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:20.170778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-56b33fbd-3eb1-4510-b35b-e5509e3f27ff None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:20.172342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-56b33fbd-3eb1-4510-b35b-e5509e3f27ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:20.264438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cb43-0e7a-4b62-90f9-ee1932422f3b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.264757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cb43-0e7a-4b62-90f9-ee1932422f3b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.265018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cb43-0e7a-4b62-90f9-ee1932422f3b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.266451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 107/210] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:45:20.272780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 104/211] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:20.277866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadebe-098a-4bd8-a027-6482d7116091 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.277866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadebe-098a-4bd8-a027-6482d7116091 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.277866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadebe-098a-4bd8-a027-6482d7116091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.297857 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b33fbd-3eb1-4510-b35b-e5509e3f27ff None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:20.308983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-eedadebe-098a-4bd8-a027-6482d7116091 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:20.310250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eedadebe-098a-4bd8-a027-6482d7116091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:20.317596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:20.444369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 108/212] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:20.495334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedadebe-098a-4bd8-a027-6482d7116091 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:20.503887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b33fbd-3eb1-4510-b35b-e5509e3f27ff None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:20.555282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef8add-5071-45a4-98ad-f74b11de7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:20.556258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef8add-5071-45a4-98ad-f74b11de7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.556554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef8add-5071-45a4-98ad-f74b11de7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.556840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef8add-5071-45a4-98ad-f74b11de7dc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.571999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef8add-5071-45a4-98ad-f74b11de7dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c5ef8add-5071-45a4-98ad-f74b11de7dc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:20.582514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:20.583410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:20.584493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 105/213] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:20.588047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:20.591468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef8add-5071-45a4-98ad-f74b11de7dc3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:20.619753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedadebe-098a-4bd8-a027-6482d7116091 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:20.671687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11193d-0f4c-4d64-af43-97ca5595625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:20.672412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11193d-0f4c-4d64-af43-97ca5595625b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.672692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11193d-0f4c-4d64-af43-97ca5595625b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.672973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11193d-0f4c-4d64-af43-97ca5595625b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.675558 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11193d-0f4c-4d64-af43-97ca5595625b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:20.676458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11193d-0f4c-4d64-af43-97ca5595625b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:20.679168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 109/214] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:20.690521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11193d-0f4c-4d64-af43-97ca5595625b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:20.695996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:20.749675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef8add-5071-45a4-98ad-f74b11de7dc3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:20.800254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:20.801169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.801668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.802092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.803888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:20.804394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:20.806015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:20.815905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 106/215] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:20.825596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:20.843520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11193d-0f4c-4d64-af43-97ca5595625b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:20.890077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a594cd-4f09-4706-a183-b2307bd4a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:20.891026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a594cd-4f09-4706-a183-b2307bd4a6bc None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.891313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a594cd-4f09-4706-a183-b2307bd4a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.891645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a594cd-4f09-4706-a183-b2307bd4a6bc None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:20.892965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a594cd-4f09-4706-a183-b2307bd4a6bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:20.894449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a594cd-4f09-4706-a183-b2307bd4a6bc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:20.917766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:20.925199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 110/216] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:20 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:20.947811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720fb97-2875-444b-9b2b-fb70ed6a84f3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:20.982925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:20.990950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896c847-5524-4254-a85b-81346db323ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:20.992411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c847-5524-4254-a85b-81346db323ee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:20.992847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c847-5524-4254-a85b-81346db323ee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:20.993277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c847-5524-4254-a85b-81346db323ee None admin] PATH_INFO: `/v3/users/b7eb0eb126944cc889ecc6b50bd4cf15` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.011520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896c847-5524-4254-a85b-81346db323ee None admin] RBAC: Authorizing `identity:get_user(user_id=b7eb0eb126944cc889ecc6b50bd4cf15)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:21.013335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896c847-5524-4254-a85b-81346db323ee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:21.020310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 107/217] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:20 2022] GET /identity/v3/users/b7eb0eb126944cc889ecc6b50bd4cf15 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:21.022722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a594cd-4f09-4706-a183-b2307bd4a6bc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:21.160157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a594cd-4f09-4706-a183-b2307bd4a6bc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:21.199290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823b1c-3f49-4a5c-8837-e95b1fc39a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:21.199844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823b1c-3f49-4a5c-8837-e95b1fc39a2c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:21.200139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823b1c-3f49-4a5c-8837-e95b1fc39a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:21.200430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823b1c-3f49-4a5c-8837-e95b1fc39a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.282804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29823b1c-3f49-4a5c-8837-e95b1fc39a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:21.284459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29823b1c-3f49-4a5c-8837-e95b1fc39a2c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:21.289015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:21.407900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 111/218] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:21.414748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896c847-5524-4254-a85b-81346db323ee None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:21.539922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896c847-5524-4254-a85b-81346db323ee None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:21.579896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a03a8-f6f3-4f0e-aa38-add44e72c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:21.580858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a03a8-f6f3-4f0e-aa38-add44e72c8dd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:21.581177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a03a8-f6f3-4f0e-aa38-add44e72c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:21.581462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a03a8-f6f3-4f0e-aa38-add44e72c8dd None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.582691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a03a8-f6f3-4f0e-aa38-add44e72c8dd None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:21.584872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a03a8-f6f3-4f0e-aa38-add44e72c8dd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:21.587012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 108/219] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:21 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:21.592722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823b1c-3f49-4a5c-8837-e95b1fc39a2c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:21.607614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feca36-46d1-4df1-ae39-3577503f1309 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:21.608079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feca36-46d1-4df1-ae39-3577503f1309 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:21.608494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feca36-46d1-4df1-ae39-3577503f1309 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.609954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 109/220] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:21.618260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8fbb1-549a-4d3e-a615-ff9a5eb6156e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:21.618568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8fbb1-549a-4d3e-a615-ff9a5eb6156e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:21.618901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8fbb1-549a-4d3e-a615-ff9a5eb6156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.649442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e0f8fbb1-549a-4d3e-a615-ff9a5eb6156e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:21.650685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e0f8fbb1-549a-4d3e-a615-ff9a5eb6156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:21.725096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:21.742143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:21.745152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 110/221] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:21.746851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecaca0-732f-46f7-8f08-eb32d379165b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:21.746966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823b1c-3f49-4a5c-8837-e95b1fc39a2c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:21.747152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecaca0-732f-46f7-8f08-eb32d379165b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:21.747426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecaca0-732f-46f7-8f08-eb32d379165b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.752938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 111/222] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:21.754753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f16e-e3d8-4642-b09a-bc5924bbde97 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:21.755120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f16e-e3d8-4642-b09a-bc5924bbde97 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:21.755475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f16e-e3d8-4642-b09a-bc5924bbde97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.773327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9e38f16e-e3d8-4642-b09a-bc5924bbde97 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:21.774675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9e38f16e-e3d8-4642-b09a-bc5924bbde97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:21.790250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:21.790915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:21.791201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:21.791480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.792577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] RBAC: Adding query filter params (role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9, user.id=b7eb0eb126944cc889ecc6b50bd4cf15) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:21.792938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:21.794678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:21.801120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 112/223] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:21 2022] GET /identity/v3/role_assignments?user.id=b7eb0eb126944cc889ecc6b50bd4cf15&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:21.802004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:21.895969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 112/224] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:21.918151 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43186bc7-10a4-4f36-9587-6f42b10284db None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:21.935078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38f16e-e3d8-4642-b09a-bc5924bbde97 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:21.960000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6510f9-d65e-4995-927c-3fdebd2ee6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:21.960826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6510f9-d65e-4995-927c-3fdebd2ee6ff None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:21.961179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6510f9-d65e-4995-927c-3fdebd2ee6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:21.961463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6510f9-d65e-4995-927c-3fdebd2ee6ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:21.974103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6510f9-d65e-4995-927c-3fdebd2ee6ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3d6510f9-d65e-4995-927c-3fdebd2ee6ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:21.982901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:21.983884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:21.984679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 113/225] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:21.992401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6510f9-d65e-4995-927c-3fdebd2ee6ff None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:22.033584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:22.113978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6510f9-d65e-4995-927c-3fdebd2ee6ff None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:22.150319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38f16e-e3d8-4642-b09a-bc5924bbde97 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:22.160787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:22.161616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:22.162658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:22.163234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:22.164133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:22.164529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:22.169589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:22.175418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 114/226] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:22.182777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:22.193961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:22.229830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be3fa-80d3-4363-b66a-a2e24244caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:22.231090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be3fa-80d3-4363-b66a-a2e24244caa9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:22.231574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be3fa-80d3-4363-b66a-a2e24244caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:22.232125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be3fa-80d3-4363-b66a-a2e24244caa9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:22.255782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2be3fa-80d3-4363-b66a-a2e24244caa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4b2be3fa-80d3-4363-b66a-a2e24244caa9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:22.273727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:22.274653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:22.275441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:22.278425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 113/227] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:22.284730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be3fa-80d3-4363-b66a-a2e24244caa9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:22.286108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:22.303217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42249a-9318-4cb8-b03f-3c0c7401aaf2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:22.340080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543bd6-a5db-458b-aece-36a4ce4285dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:22.341007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543bd6-a5db-458b-aece-36a4ce4285dc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:22.341317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543bd6-a5db-458b-aece-36a4ce4285dc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:22.341618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543bd6-a5db-458b-aece-36a4ce4285dc None admin] PATH_INFO: `/v3/users/dfa654c5773d44a6bd732131d50b2d58` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:22.342995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b543bd6-a5db-458b-aece-36a4ce4285dc None admin] RBAC: Authorizing `identity:get_user(user_id=dfa654c5773d44a6bd732131d50b2d58)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:22.344448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b543bd6-a5db-458b-aece-36a4ce4285dc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:22.346326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 115/228] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:22 2022] GET /identity/v3/users/dfa654c5773d44a6bd732131d50b2d58 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:22.352675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543bd6-a5db-458b-aece-36a4ce4285dc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:22.469746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543bd6-a5db-458b-aece-36a4ce4285dc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:22.522712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be3fa-80d3-4363-b66a-a2e24244caa9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:22.536904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2928e7-32e6-4398-8ce6-554d6ae07002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:22.538736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2928e7-32e6-4398-8ce6-554d6ae07002 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:22.539026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2928e7-32e6-4398-8ce6-554d6ae07002 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:22.539308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2928e7-32e6-4398-8ce6-554d6ae07002 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:22.540703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2928e7-32e6-4398-8ce6-554d6ae07002 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:22.542223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2928e7-32e6-4398-8ce6-554d6ae07002 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:22.544280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 116/229] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:22 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:22.551330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2928e7-32e6-4398-8ce6-554d6ae07002 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:22.598008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:22.602921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:22.603875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:22.603875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:22.604163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:22.605603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:22.606047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:22.607599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:22.621402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 114/230] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:22.627631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:22.691154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:22.741097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2928e7-32e6-4398-8ce6-554d6ae07002 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:22.809851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cf9d4-07a0-4930-947e-038964e9e217 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:22.816285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198e48c-cc02-4749-b646-bc7af93ef3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:22.817212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198e48c-cc02-4749-b646-bc7af93ef3ae None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:22.817499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198e48c-cc02-4749-b646-bc7af93ef3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:22.817808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198e48c-cc02-4749-b646-bc7af93ef3ae None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/users/dfa654c5773d44a6bd732131d50b2d58/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:22.825793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198e48c-cc02-4749-b646-bc7af93ef3ae None admin] RBAC: Authorizing `identity:create_grant(project_id=cf204ba855ce4d5db5fc90ea1cde42f9, user_id=dfa654c5773d44a6bd732131d50b2d58, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:22.827287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198e48c-cc02-4749-b646-bc7af93ef3ae None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:22.849838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 117/231] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:22 2022] PUT /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/users/dfa654c5773d44a6bd732131d50b2d58/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:22.869181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837efd-a8da-43c9-80c0-4978b5d8ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:22.870139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837efd-a8da-43c9-80c0-4978b5d8ca3d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:22.870422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837efd-a8da-43c9-80c0-4978b5d8ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:22.870701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837efd-a8da-43c9-80c0-4978b5d8ca3d None admin] PATH_INFO: `/v3/users/dfa654c5773d44a6bd732131d50b2d58` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:22.871949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed837efd-a8da-43c9-80c0-4978b5d8ca3d None admin] RBAC: Authorizing `identity:get_user(user_id=dfa654c5773d44a6bd732131d50b2d58)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:22.873416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed837efd-a8da-43c9-80c0-4978b5d8ca3d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:22.879414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 115/232] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:22 2022] GET /identity/v3/users/dfa654c5773d44a6bd732131d50b2d58 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:22.886072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198e48c-cc02-4749-b646-bc7af93ef3ae None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:23.019593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:23.051992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198e48c-cc02-4749-b646-bc7af93ef3ae None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:23.119577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c9673-a5ac-4de3-baa8-18762f45cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:23.120544 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c9673-a5ac-4de3-baa8-18762f45cccd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:23.120900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c9673-a5ac-4de3-baa8-18762f45cccd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:23.121226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c9673-a5ac-4de3-baa8-18762f45cccd None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:23.122679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c9673-a5ac-4de3-baa8-18762f45cccd None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:23.124165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c9673-a5ac-4de3-baa8-18762f45cccd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:23.126312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 118/233] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:22 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:23.137471 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837efd-a8da-43c9-80c0-4978b5d8ca3d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:23.288960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837efd-a8da-43c9-80c0-4978b5d8ca3d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:23.298561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:23.327430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b2654-2d6f-4513-a5df-a111998f9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:23.328350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b2654-2d6f-4513-a5df-a111998f9cb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:23.328684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b2654-2d6f-4513-a5df-a111998f9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:23.328971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b2654-2d6f-4513-a5df-a111998f9cb7 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/users/dfa654c5773d44a6bd732131d50b2d58/roles/025cadb68d6641098d3edb9e47910aaf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:23.332263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b2654-2d6f-4513-a5df-a111998f9cb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf204ba855ce4d5db5fc90ea1cde42f9, user_id=dfa654c5773d44a6bd732131d50b2d58, role_id=025cadb68d6641098d3edb9e47910aaf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:23.333854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b2654-2d6f-4513-a5df-a111998f9cb7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:23.354528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 116/234] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:23 2022] PUT /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/users/dfa654c5773d44a6bd732131d50b2d58/roles/025cadb68d6641098d3edb9e47910aaf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:23.787890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7cf49-d260-4171-8a79-165a34265aa0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:23.788318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7cf49-d260-4171-8a79-165a34265aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:23.788492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7cf49-d260-4171-8a79-165a34265aa0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:23.789903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 119/235] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:23.795405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7957-33ad-46ad-a3d7-42c1fa4890bc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:23.795707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7957-33ad-46ad-a3d7-42c1fa4890bc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:23.795996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7957-33ad-46ad-a3d7-42c1fa4890bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:23.814724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cddb7957-33ad-46ad-a3d7-42c1fa4890bc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:23.815931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cddb7957-33ad-46ad-a3d7-42c1fa4890bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:23.889854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 117/236] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:23.915328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7cf49-d260-4171-8a79-165a34265aa0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:24.071691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7cf49-d260-4171-8a79-165a34265aa0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:24.126578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb042e-ba13-4b95-aece-9535142995f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:24.127392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb042e-ba13-4b95-aece-9535142995f9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.127683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb042e-ba13-4b95-aece-9535142995f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.127967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb042e-ba13-4b95-aece-9535142995f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.149891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb042e-ba13-4b95-aece-9535142995f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bddb042e-ba13-4b95-aece-9535142995f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:24.157712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:24.158629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:24.159849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 120/237] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:24.166674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb7957-33ad-46ad-a3d7-42c1fa4890bc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:24.256856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6164-df2c-4f95-859b-be04c1325be3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.257176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6164-df2c-4f95-859b-be04c1325be3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.259909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6164-df2c-4f95-859b-be04c1325be3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.259909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 121/238] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:45:24.265831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224e2fc-d7e9-475c-80ff-80940562ae1c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.266279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224e2fc-d7e9-475c-80ff-80940562ae1c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.266568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224e2fc-d7e9-475c-80ff-80940562ae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.301290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b224e2fc-d7e9-475c-80ff-80940562ae1c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:24.303088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b224e2fc-d7e9-475c-80ff-80940562ae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:24.311609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:24.334553 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:24.346452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb7957-33ad-46ad-a3d7-42c1fa4890bc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:24.421739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:24.421739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.421739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.421739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.422156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:24.422156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:24.422907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:24.433757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 118/239] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:24.439046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:24.483038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 122/240] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:24.531486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224e2fc-d7e9-475c-80ff-80940562ae1c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:24.562887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81e882-1431-4ac5-9543-f486f8ac7b08 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:24.611204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0fcc9-8a46-4419-8f34-4e00ab3cfe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:24.612135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0fcc9-8a46-4419-8f34-4e00ab3cfe7a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.612426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0fcc9-8a46-4419-8f34-4e00ab3cfe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.612707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0fcc9-8a46-4419-8f34-4e00ab3cfe7a None admin] PATH_INFO: `/v3/users/3cb3482609ce464c948378f14a7b48c4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.628135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0fcc9-8a46-4419-8f34-4e00ab3cfe7a None admin] RBAC: Authorizing `identity:get_user(user_id=3cb3482609ce464c948378f14a7b48c4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:24.629653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0fcc9-8a46-4419-8f34-4e00ab3cfe7a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:24.632893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 119/241] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:24 2022] GET /identity/v3/users/3cb3482609ce464c948378f14a7b48c4 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:24.642550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0fcc9-8a46-4419-8f34-4e00ab3cfe7a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:24.685914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:24.711370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224e2fc-d7e9-475c-80ff-80940562ae1c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:24.752045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eb94a-0e68-4255-a71a-e9b4fb6758de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:24.753328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb94a-0e68-4255-a71a-e9b4fb6758de None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.754787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb94a-0e68-4255-a71a-e9b4fb6758de None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.755976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb94a-0e68-4255-a71a-e9b4fb6758de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.759756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eb94a-0e68-4255-a71a-e9b4fb6758de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:24.762097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eb94a-0e68-4255-a71a-e9b4fb6758de None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:24.763978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 123/242] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:24.769150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eb94a-0e68-4255-a71a-e9b4fb6758de None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:24.780710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:24.878346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0fcc9-8a46-4419-8f34-4e00ab3cfe7a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:24.881612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eb94a-0e68-4255-a71a-e9b4fb6758de None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:24.923384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423649-ae72-468f-b875-459a2ecd8eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:24.924060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423649-ae72-468f-b875-459a2ecd8eef None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.924347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423649-ae72-468f-b875-459a2ecd8eef None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.924629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423649-ae72-468f-b875-459a2ecd8eef None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.925340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9423649-ae72-468f-b875-459a2ecd8eef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:24.926828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9423649-ae72-468f-b875-459a2ecd8eef None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:24.927667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e9596-c0d3-47ba-87a4-853d1d8cb00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:24.928676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e9596-c0d3-47ba-87a4-853d1d8cb00c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.929171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e9596-c0d3-47ba-87a4-853d1d8cb00c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.929705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e9596-c0d3-47ba-87a4-853d1d8cb00c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.957645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 124/243] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:24 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:45:24.960301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a0b4-acf7-4a8b-b587-64179a62d132 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.960940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a0b4-acf7-4a8b-b587-64179a62d132 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.961489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a0b4-acf7-4a8b-b587-64179a62d132 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:24.964932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 125/244] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:24.975786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac803a2-885b-42ed-9b81-ffaed1ac5067 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:24.976401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac803a2-885b-42ed-9b81-ffaed1ac5067 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:24.976937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac803a2-885b-42ed-9b81-ffaed1ac5067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:25.011570 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9ac803a2-885b-42ed-9b81-ffaed1ac5067 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:25.015837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9ac803a2-885b-42ed-9b81-ffaed1ac5067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:25.071983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e9596-c0d3-47ba-87a4-853d1d8cb00c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:25.074071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e9596-c0d3-47ba-87a4-853d1d8cb00c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:25.115844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:25.135094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:25.153764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 126/245] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:25.205213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac803a2-885b-42ed-9b81-ffaed1ac5067 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:25.268083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 120/246] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:25.274593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e9596-c0d3-47ba-87a4-853d1d8cb00c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:25.363542 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac803a2-885b-42ed-9b81-ffaed1ac5067 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:25.392793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e9596-c0d3-47ba-87a4-853d1d8cb00c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:25.420750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:25.424797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867967d6-f215-4242-9507-65e821314026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:25.425879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867967d6-f215-4242-9507-65e821314026 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:25.426172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867967d6-f215-4242-9507-65e821314026 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:25.428094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867967d6-f215-4242-9507-65e821314026 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:25.442434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867967d6-f215-4242-9507-65e821314026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:25.446364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457c6b-5efe-4a61-9359-4442368b3a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:25.447393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457c6b-5efe-4a61-9359-4442368b3a77 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:25.447781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457c6b-5efe-4a61-9359-4442368b3a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:25.448171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457c6b-5efe-4a61-9359-4442368b3a77 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:25.451858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b457c6b-5efe-4a61-9359-4442368b3a77 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:25.453405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b457c6b-5efe-4a61-9359-4442368b3a77 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-867967d6-f215-4242-9507-65e821314026 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:25.458025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:25.459028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:25.459805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 127/247] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:25.460528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 121/248] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:25 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:25.466056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457c6b-5efe-4a61-9359-4442368b3a77 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:25.466777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867967d6-f215-4242-9507-65e821314026 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:25.548222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:25.598578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457c6b-5efe-4a61-9359-4442368b3a77 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:25.604390 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867967d6-f215-4242-9507-65e821314026 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:25.638414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:25.639243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:25.639634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:25.640042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:25.641096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] RBAC: Adding query filter params (role.id=c55bd507a50c4e61b27c205ea173975b, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9, user.id=3cb3482609ce464c948378f14a7b48c4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:25.641520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:25.643357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:25.650887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 122/249] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:25 2022] GET /identity/v3/role_assignments?user.id=3cb3482609ce464c948378f14a7b48c4&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=c55bd507a50c4e61b27c205ea173975b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:25.664451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:25.665574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:25.666217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:25.666731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:25.667790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:25.668331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:25.670421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:25.685336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 128/250] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:25.693086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:25.760416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:25.821739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894af2a-4438-4fdb-82cb-f1269509b9dd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:25.872006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91c35b-3b5f-4ea6-9e5b-1f54e7ab3732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:25.873302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91c35b-3b5f-4ea6-9e5b-1f54e7ab3732 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:25.873826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91c35b-3b5f-4ea6-9e5b-1f54e7ab3732 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:25.874314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91c35b-3b5f-4ea6-9e5b-1f54e7ab3732 None admin] PATH_INFO: `/v3/users/b7eb0eb126944cc889ecc6b50bd4cf15` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:25.876020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91c35b-3b5f-4ea6-9e5b-1f54e7ab3732 None admin] RBAC: Authorizing `identity:get_user(user_id=b7eb0eb126944cc889ecc6b50bd4cf15)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:25.877863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91c35b-3b5f-4ea6-9e5b-1f54e7ab3732 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:25.879957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 123/251] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:25 2022] GET /identity/v3/users/b7eb0eb126944cc889ecc6b50bd4cf15 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:25.886347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:25.923941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeeee5-92f4-425b-8be0-6a66ab6fc2b2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:25.924230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeeee5-92f4-425b-8be0-6a66ab6fc2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:25.924432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeeee5-92f4-425b-8be0-6a66ab6fc2b2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:25.925902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 124/252] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:45:25.938349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35676-e69e-4811-911d-35bda0c48ed2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:25.938969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35676-e69e-4811-911d-35bda0c48ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:25.939452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35676-e69e-4811-911d-35bda0c48ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:25.975251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d3f35676-e69e-4811-911d-35bda0c48ed2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:25.978822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d3f35676-e69e-4811-911d-35bda0c48ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:26.060331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200fbd1-27cf-4206-b44b-95ae118b8353 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:26.080228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:26.111151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 125/253] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:26.119774 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb1551-6bb8-4b68-b856-099827a87444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:26.121010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb1551-6bb8-4b68-b856-099827a87444 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:26.121499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb1551-6bb8-4b68-b856-099827a87444 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:26.122004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb1551-6bb8-4b68-b856-099827a87444 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:26.123472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb1551-6bb8-4b68-b856-099827a87444 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:26.125169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb1551-6bb8-4b68-b856-099827a87444 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:26.127447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 129/254] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:25 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:26.133482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f35676-e69e-4811-911d-35bda0c48ed2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:26.154661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb1551-6bb8-4b68-b856-099827a87444 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:26.249660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:26.374001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f35676-e69e-4811-911d-35bda0c48ed2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:26.421169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb1551-6bb8-4b68-b856-099827a87444 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:26.471217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee71f6e-d923-4b7f-88f8-6f785d7936aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:26.472415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee71f6e-d923-4b7f-88f8-6f785d7936aa None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:26.472703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee71f6e-d923-4b7f-88f8-6f785d7936aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:26.472986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee71f6e-d923-4b7f-88f8-6f785d7936aa None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/users/b7eb0eb126944cc889ecc6b50bd4cf15/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:26.476222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee71f6e-d923-4b7f-88f8-6f785d7936aa None admin] RBAC: Authorizing `identity:create_grant(project_id=cf204ba855ce4d5db5fc90ea1cde42f9, user_id=b7eb0eb126944cc889ecc6b50bd4cf15, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:26.478301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee71f6e-d923-4b7f-88f8-6f785d7936aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:26.493517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0ea93-35aa-4b50-8444-54fe72ec236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:26.494549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ea93-35aa-4b50-8444-54fe72ec236c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:26.494839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ea93-35aa-4b50-8444-54fe72ec236c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:26.495121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ea93-35aa-4b50-8444-54fe72ec236c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:26.507631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 126/255] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:26 2022] PUT /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/users/b7eb0eb126944cc889ecc6b50bd4cf15/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:26.526723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0ea93-35aa-4b50-8444-54fe72ec236c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d6f0ea93-35aa-4b50-8444-54fe72ec236c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:26.534601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:26.536012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:26.537497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 130/256] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:26.542307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee71f6e-d923-4b7f-88f8-6f785d7936aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:26.608907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539f5dd-bd0e-42ee-b0a8-7ee09671c072 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:26.609316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539f5dd-bd0e-42ee-b0a8-7ee09671c072 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:26.609524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539f5dd-bd0e-42ee-b0a8-7ee09671c072 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:26.614451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 131/257] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:26.617303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ac1e-8300-446e-b47a-6742c8c19a67 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:26.617618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ac1e-8300-446e-b47a-6742c8c19a67 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:26.617907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ac1e-8300-446e-b47a-6742c8c19a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:26.637142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4e77ac1e-8300-446e-b47a-6742c8c19a67 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:26.638382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e77ac1e-8300-446e-b47a-6742c8c19a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:26.684471 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee71f6e-d923-4b7f-88f8-6f785d7936aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:26.684938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:26.706039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:26.721764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 132/258] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:26.741382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77ac1e-8300-446e-b47a-6742c8c19a67 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:26.759778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:26.760382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:26.760669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:26.760951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:26.761754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:26.762064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:26.763480 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:26.777676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 127/259] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:26.796258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:26.903596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77ac1e-8300-446e-b47a-6742c8c19a67 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:26.976563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15c1be-592f-432c-a999-f4425f862b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:26.977623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c1be-592f-432c-a999-f4425f862b40 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:26.978280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c1be-592f-432c-a999-f4425f862b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:26.978574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c1be-592f-432c-a999-f4425f862b40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:26.984709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83764f-081d-4dc8-b44a-3da57cb6bf2e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:26.997588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15c1be-592f-432c-a999-f4425f862b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6e15c1be-592f-432c-a999-f4425f862b40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:27.010507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:27.011933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:27.013206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 133/260] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:27.018561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15c1be-592f-432c-a999-f4425f862b40 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:27.044604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791006e-1450-4cd9-903a-f22656a334aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:27.045510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791006e-1450-4cd9-903a-f22656a334aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:27.045824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791006e-1450-4cd9-903a-f22656a334aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:27.046116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791006e-1450-4cd9-903a-f22656a334aa None admin] PATH_INFO: `/v3/users/dfa654c5773d44a6bd732131d50b2d58` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:27.048782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791006e-1450-4cd9-903a-f22656a334aa None admin] RBAC: Authorizing `identity:get_user(user_id=dfa654c5773d44a6bd732131d50b2d58)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:27.050407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791006e-1450-4cd9-903a-f22656a334aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:27.056920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 128/261] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:26 2022] GET /identity/v3/users/dfa654c5773d44a6bd732131d50b2d58 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:27.063010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791006e-1450-4cd9-903a-f22656a334aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:27.111806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:27.166090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:27.227351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15c1be-592f-432c-a999-f4425f862b40 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:27.264306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:27.264906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:27.265201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:27.265488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:27.269567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:27.269567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:27.269567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:27.276551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 134/262] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:27.282194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:27.322478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791006e-1450-4cd9-903a-f22656a334aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:27.388751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd974f-9ad1-4216-8b67-075056ffc934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:27.389424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd974f-9ad1-4216-8b67-075056ffc934 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:27.389743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd974f-9ad1-4216-8b67-075056ffc934 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:27.390087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd974f-9ad1-4216-8b67-075056ffc934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:27.436110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:27.442040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bf25-b735-411a-9a7b-1c8bc821c6dd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:27.499832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd974f-9ad1-4216-8b67-075056ffc934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:27.501335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd974f-9ad1-4216-8b67-075056ffc934 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:27.526386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03897-2174-4a0d-958d-24ce4f9f7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:27.527199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03897-2174-4a0d-958d-24ce4f9f7e96 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:27.527488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03897-2174-4a0d-958d-24ce4f9f7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:27.527772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03897-2174-4a0d-958d-24ce4f9f7e96 None admin] PATH_INFO: `/v3/users/dfa654c5773d44a6bd732131d50b2d58` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:27.529043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e03897-2174-4a0d-958d-24ce4f9f7e96 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa654c5773d44a6bd732131d50b2d58)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:27.530550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e03897-2174-4a0d-958d-24ce4f9f7e96 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:27.532511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 135/263] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:27 2022] GET /identity/v3/users/dfa654c5773d44a6bd732131d50b2d58 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:27.537910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03897-2174-4a0d-958d-24ce4f9f7e96 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:27.540669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:27.617751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 129/264] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 12:45:27.623032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd974f-9ad1-4216-8b67-075056ffc934 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:27.757289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03897-2174-4a0d-958d-24ce4f9f7e96 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:27.823208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26a1ec-f7ed-4761-9da5-cc4be6af35c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:27.823887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a1ec-f7ed-4761-9da5-cc4be6af35c5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:27.824179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a1ec-f7ed-4761-9da5-cc4be6af35c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:27.824466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a1ec-f7ed-4761-9da5-cc4be6af35c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:27.869925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:27.899538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd974f-9ad1-4216-8b67-075056ffc934 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:27.921228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26a1ec-f7ed-4761-9da5-cc4be6af35c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:27.929165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26a1ec-f7ed-4761-9da5-cc4be6af35c5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:28.044447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e415-79e7-4d66-b6ec-069e790fd9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:28.045345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e415-79e7-4d66-b6ec-069e790fd9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:28.045667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e415-79e7-4d66-b6ec-069e790fd9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:28.045951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e415-79e7-4d66-b6ec-069e790fd9d9 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:28.050268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e415-79e7-4d66-b6ec-069e790fd9d9 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:28.051769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e415-79e7-4d66-b6ec-069e790fd9d9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:28.054381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 130/265] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:27 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:28.062465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e415-79e7-4d66-b6ec-069e790fd9d9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:28.075570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:28.076791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 136/266] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 12:45:28.082830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26a1ec-f7ed-4761-9da5-cc4be6af35c5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:28.189903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:28.298908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26a1ec-f7ed-4761-9da5-cc4be6af35c5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:28.328453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e415-79e7-4d66-b6ec-069e790fd9d9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:28.385488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:28.386204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:28.387017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:28.387310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:28.388354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9, user.id=dfa654c5773d44a6bd732131d50b2d58) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:28.388684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:28.390304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:28.405067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 131/267] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:28 2022] GET /identity/v3/role_assignments?user.id=dfa654c5773d44a6bd732131d50b2d58&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:28.434733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941ae10-6ac0-4add-9792-42e705239e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:28.436165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941ae10-6ac0-4add-9792-42e705239e51 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:28.436620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941ae10-6ac0-4add-9792-42e705239e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:28.437069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941ae10-6ac0-4add-9792-42e705239e51 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:28.439131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941ae10-6ac0-4add-9792-42e705239e51 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:28.441520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941ae10-6ac0-4add-9792-42e705239e51 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:28.445190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 137/268] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:28 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:28.451373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:28.576525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:28.663476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2661f9-7d48-46f5-8902-ab13b9c0da5e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:28.756429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925a45c-7407-4720-8174-cee0cdec9733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:28.757709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a45c-7407-4720-8174-cee0cdec9733 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:28.758177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a45c-7407-4720-8174-cee0cdec9733 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:28.758629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a45c-7407-4720-8174-cee0cdec9733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:28.760305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925a45c-7407-4720-8174-cee0cdec9733 None admin] RBAC: Adding query filter params (role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9, user.id=dfa654c5773d44a6bd732131d50b2d58) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:28.760830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925a45c-7407-4720-8174-cee0cdec9733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:28.763414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925a45c-7407-4720-8174-cee0cdec9733 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:28.778035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 132/269] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:28 2022] GET /identity/v3/role_assignments?user.id=dfa654c5773d44a6bd732131d50b2d58&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=025cadb68d6641098d3edb9e47910aaf => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:29.053279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bad60-c9ca-4272-88ec-e3d671b6ca28 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.053480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bad60-c9ca-4272-88ec-e3d671b6ca28 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.053767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bad60-c9ca-4272-88ec-e3d671b6ca28 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.055783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 138/270] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:29.059082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c98c0-fc9e-4720-99f0-7cd3e6572091 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.059371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c98c0-fc9e-4720-99f0-7cd3e6572091 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.059885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c98c0-fc9e-4720-99f0-7cd3e6572091 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.061655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 133/271] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:29.062673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b5467-029f-45e7-ab6a-0a8b1ca2d7df None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.062974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b5467-029f-45e7-ab6a-0a8b1ca2d7df None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.063265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b5467-029f-45e7-ab6a-0a8b1ca2d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.067602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c179d7-6773-425b-86a8-d6cfa4be6d0a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.068524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c179d7-6773-425b-86a8-d6cfa4be6d0a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.069275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c179d7-6773-425b-86a8-d6cfa4be6d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.083340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-316b5467-029f-45e7-ab6a-0a8b1ca2d7df None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:29.085002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-316b5467-029f-45e7-ab6a-0a8b1ca2d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:29.102741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-71c179d7-6773-425b-86a8-d6cfa4be6d0a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:29.103983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-71c179d7-6773-425b-86a8-d6cfa4be6d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:29.182522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 139/272] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:29.184025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272704c-846d-451d-9836-9c03b520c445 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.184320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272704c-846d-451d-9836-9c03b520c445 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.184602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272704c-846d-451d-9836-9c03b520c445 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.187069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 140/273] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:29.191257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8112-0b9c-4c08-8fae-7b4ef60dd0f8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.191724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8112-0b9c-4c08-8fae-7b4ef60dd0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.192157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8112-0b9c-4c08-8fae-7b4ef60dd0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.220842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-762d8112-0b9c-4c08-8fae-7b4ef60dd0f8 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:29.223078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-762d8112-0b9c-4c08-8fae-7b4ef60dd0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:29.228420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 134/274] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:29.229506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c179d7-6773-425b-86a8-d6cfa4be6d0a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:29.303479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:29.316059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:29.321209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 141/275] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:29.322402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8112-0b9c-4c08-8fae-7b4ef60dd0f8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:29.364208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c179d7-6773-425b-86a8-d6cfa4be6d0a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:29.413488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151bace-a37c-43e8-928b-3cb9668bda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:29.414613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151bace-a37c-43e8-928b-3cb9668bda02 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.414905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151bace-a37c-43e8-928b-3cb9668bda02 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.415712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151bace-a37c-43e8-928b-3cb9668bda02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.417174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151bace-a37c-43e8-928b-3cb9668bda02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:29.419198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151bace-a37c-43e8-928b-3cb9668bda02 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:29.421043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 135/276] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:29.422152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151bace-a37c-43e8-928b-3cb9668bda02 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:29.435824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8112-0b9c-4c08-8fae-7b4ef60dd0f8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:29.472510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8a1be-af80-4da6-a96c-7963d72799b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:29.473329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a1be-af80-4da6-a96c-7963d72799b7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.473653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a1be-af80-4da6-a96c-7963d72799b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.473942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a1be-af80-4da6-a96c-7963d72799b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.485857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8a1be-af80-4da6-a96c-7963d72799b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-67e8a1be-af80-4da6-a96c-7963d72799b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:29.494354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:29.495493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 142/277] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:29.496488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8a1be-af80-4da6-a96c-7963d72799b7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:29.543822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151bace-a37c-43e8-928b-3cb9668bda02 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:29.555521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:29.576611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:29.585684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1214-9d43-4076-81e1-b2eeec09a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:29.587007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1214-9d43-4076-81e1-b2eeec09a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.587446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1214-9d43-4076-81e1-b2eeec09a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.587883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1214-9d43-4076-81e1-b2eeec09a1a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.601380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed1214-9d43-4076-81e1-b2eeec09a1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-94ed1214-9d43-4076-81e1-b2eeec09a1a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:29.609333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:29.610431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:29.611242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 136/278] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:29.611908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1214-9d43-4076-81e1-b2eeec09a1a3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:29.618276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8a1be-af80-4da6-a96c-7963d72799b7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:29.656025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf365080-24a1-4abe-85e4-052bd94c29f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:29.656713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf365080-24a1-4abe-85e4-052bd94c29f0 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.657003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf365080-24a1-4abe-85e4-052bd94c29f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.657289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf365080-24a1-4abe-85e4-052bd94c29f0 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.658042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf365080-24a1-4abe-85e4-052bd94c29f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:29.659639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf365080-24a1-4abe-85e4-052bd94c29f0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:29.683428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 143/279] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:29 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:29.694670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf365080-24a1-4abe-85e4-052bd94c29f0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:29.732449 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1214-9d43-4076-81e1-b2eeec09a1a3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:29.774814 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:29.775836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.776336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.776786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.777894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:29.778370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:29.780030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:29.790789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 137/280] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:29.797408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:29.857966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf365080-24a1-4abe-85e4-052bd94c29f0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:29.869793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:29.872596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:29.902216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:29.902792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.903081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.903362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:29.904132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:29.904447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:29.905876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:29.915605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 144/281] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:29.923221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:29.933916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f86236-bb13-4581-8165-c1d4bac97755 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:29.978099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edc7cd-d907-42fd-978d-3ab35720609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:29.979166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc7cd-d907-42fd-978d-3ab35720609c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:29.979461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc7cd-d907-42fd-978d-3ab35720609c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:29.980173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc7cd-d907-42fd-978d-3ab35720609c None admin] PATH_INFO: `/v3/users/7a04286c2e1d4054a427d41f395ea014` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.001342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edc7cd-d907-42fd-978d-3ab35720609c None admin] RBAC: Authorizing `identity:get_user(user_id=7a04286c2e1d4054a427d41f395ea014)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:30.002860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edc7cd-d907-42fd-978d-3ab35720609c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:30.004788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 138/282] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:29 2022] GET /identity/v3/users/7a04286c2e1d4054a427d41f395ea014 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:30.006880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e04092-913a-42dd-b306-5b1979e3c344 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:30.007153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e04092-913a-42dd-b306-5b1979e3c344 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:30.007490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e04092-913a-42dd-b306-5b1979e3c344 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.008830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 139/283] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:30.013969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e04092-913a-42dd-b306-5b1979e3c344 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:30.058357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5bc3-80cc-4971-ba86-1d093486b97f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:30.106669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac1fb-1bf2-4c56-8941-8ecd09ff3c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:30.107891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac1fb-1bf2-4c56-8941-8ecd09ff3c68 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:30.108416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac1fb-1bf2-4c56-8941-8ecd09ff3c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:30.109122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac1fb-1bf2-4c56-8941-8ecd09ff3c68 None admin] PATH_INFO: `/v3/users/3cb3482609ce464c948378f14a7b48c4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.111178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ac1fb-1bf2-4c56-8941-8ecd09ff3c68 None admin] RBAC: Authorizing `identity:get_user(user_id=3cb3482609ce464c948378f14a7b48c4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:30.113348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ac1fb-1bf2-4c56-8941-8ecd09ff3c68 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:30.116919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 145/284] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:29 2022] GET /identity/v3/users/3cb3482609ce464c948378f14a7b48c4 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:30.118434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9f1bc-85d7-4d76-a2db-d366b40143b9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:30.118928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9f1bc-85d7-4d76-a2db-d366b40143b9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:30.120021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9f1bc-85d7-4d76-a2db-d366b40143b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.143797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7fd9f1bc-85d7-4d76-a2db-d366b40143b9 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:30.146323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7fd9f1bc-85d7-4d76-a2db-d366b40143b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:30.149027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e04092-913a-42dd-b306-5b1979e3c344 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:30.162088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:30.187958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:30.192583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:30.193877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:30.194398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:30.195597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.196955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] RBAC: Adding query filter params (role.id=a73bec0a8208424e89eba3acdec2e49a, user.id=7a04286c2e1d4054a427d41f395ea014, scope.system=all) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:30.197467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:30.199185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:30.206065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 140/285] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Jun 8 12:45:30 2022] GET /identity/v3/role_assignments?user.id=7a04286c2e1d4054a427d41f395ea014&scope.system=all&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:30.207221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:30.254142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 146/286] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:30.321461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9f1bc-85d7-4d76-a2db-d366b40143b9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:30.430520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c25525-1e86-46ab-93b9-59a4ca5a0da7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:30.479602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9f1bc-85d7-4d76-a2db-d366b40143b9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:30.506000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67f86d-3dc9-400c-b103-f2cabae0be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:30.507350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67f86d-3dc9-400c-b103-f2cabae0be2b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:30.508177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67f86d-3dc9-400c-b103-f2cabae0be2b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:30.508564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67f86d-3dc9-400c-b103-f2cabae0be2b None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.510527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67f86d-3dc9-400c-b103-f2cabae0be2b None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:30.512564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67f86d-3dc9-400c-b103-f2cabae0be2b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:30.519563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 141/287] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:30 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:30.521526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67f86d-3dc9-400c-b103-f2cabae0be2b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:30.538789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde26e4d-923f-4783-abb9-f1958e3c4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:30.540022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde26e4d-923f-4783-abb9-f1958e3c4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:30.540643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde26e4d-923f-4783-abb9-f1958e3c4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:30.541121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde26e4d-923f-4783-abb9-f1958e3c4fc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.563547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde26e4d-923f-4783-abb9-f1958e3c4fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fde26e4d-923f-4783-abb9-f1958e3c4fc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:30.572357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:30.573286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:30.574135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:30.576711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 147/288] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:30.582543 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde26e4d-923f-4783-abb9-f1958e3c4fc7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:30.590500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:30.654614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:30.664367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67f86d-3dc9-400c-b103-f2cabae0be2b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:30.710866 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ab15-79d8-4d7e-a39a-330060778b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:30.711855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ab15-79d8-4d7e-a39a-330060778b6e None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:30.712147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ab15-79d8-4d7e-a39a-330060778b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:30.712426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ab15-79d8-4d7e-a39a-330060778b6e None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/users/3cb3482609ce464c948378f14a7b48c4/roles/c55bd507a50c4e61b27c205ea173975b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.718866 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21ab15-79d8-4d7e-a39a-330060778b6e None admin] RBAC: Authorizing `identity:create_grant(project_id=cf204ba855ce4d5db5fc90ea1cde42f9, user_id=3cb3482609ce464c948378f14a7b48c4, role_id=c55bd507a50c4e61b27c205ea173975b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:30.720357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21ab15-79d8-4d7e-a39a-330060778b6e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:30.774461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 142/289] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:45:30 2022] PUT /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/users/3cb3482609ce464c948378f14a7b48c4/roles/c55bd507a50c4e61b27c205ea173975b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:30.779567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde26e4d-923f-4783-abb9-f1958e3c4fc7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:30.837758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:30.838471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:30.838765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:30.839047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:30.839844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:30.840223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:30.841715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:30.857753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 148/290] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:30.859830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ab15-79d8-4d7e-a39a-330060778b6e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:30.992462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ab15-79d8-4d7e-a39a-330060778b6e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:30.994018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:31.040349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d76b-93ad-4aff-9a00-c9cf2d1ae025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:31.041254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d76b-93ad-4aff-9a00-c9cf2d1ae025 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:31.041582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d76b-93ad-4aff-9a00-c9cf2d1ae025 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:31.041849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d76b-93ad-4aff-9a00-c9cf2d1ae025 None admin] PATH_INFO: `/v3/users/b7eb0eb126944cc889ecc6b50bd4cf15` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:31.043672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d76b-93ad-4aff-9a00-c9cf2d1ae025 None admin] RBAC: Authorizing `identity:get_user(user_id=b7eb0eb126944cc889ecc6b50bd4cf15)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:31.045186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d76b-93ad-4aff-9a00-c9cf2d1ae025 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:31.047878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 143/291] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:30 2022] GET /identity/v3/users/b7eb0eb126944cc889ecc6b50bd4cf15 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:31.053002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:31.201924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:31.211572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3f8f8-590b-435d-bd9a-060de1a19fe5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:31.261287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffdbb8-05a1-4668-aa82-ce4c416e4689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:31.261921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffdbb8-05a1-4668-aa82-ce4c416e4689 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:31.262215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffdbb8-05a1-4668-aa82-ce4c416e4689 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:31.262501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffdbb8-05a1-4668-aa82-ce4c416e4689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:31.356265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffdbb8-05a1-4668-aa82-ce4c416e4689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:31.357804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffdbb8-05a1-4668-aa82-ce4c416e4689 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:31.458071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:31.476178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 149/292] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:31.482781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d76b-93ad-4aff-9a00-c9cf2d1ae025 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:31.624226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d76b-93ad-4aff-9a00-c9cf2d1ae025 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:31.665712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ee65c-eb37-4d99-a336-30cfcbdc6734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:31.666605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee65c-eb37-4d99-a336-30cfcbdc6734 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:31.666895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee65c-eb37-4d99-a336-30cfcbdc6734 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:31.667179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee65c-eb37-4d99-a336-30cfcbdc6734 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:31.668401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ee65c-eb37-4d99-a336-30cfcbdc6734 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:31.669873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ee65c-eb37-4d99-a336-30cfcbdc6734 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:31.672591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 144/293] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:31 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:31.677686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffdbb8-05a1-4668-aa82-ce4c416e4689 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:31.928872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffdbb8-05a1-4668-aa82-ce4c416e4689 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:31.987285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bc5fb-5abf-43cd-91cb-880e86322966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:31.987971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc5fb-5abf-43cd-91cb-880e86322966 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:31.988255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc5fb-5abf-43cd-91cb-880e86322966 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:31.988531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc5fb-5abf-43cd-91cb-880e86322966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:31.989381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bc5fb-5abf-43cd-91cb-880e86322966 None admin] RBAC: Adding query filter params (role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9, user.id=b7eb0eb126944cc889ecc6b50bd4cf15) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:31.990308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bc5fb-5abf-43cd-91cb-880e86322966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:31.992066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bc5fb-5abf-43cd-91cb-880e86322966 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:32.002651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 150/294] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:31 2022] GET /identity/v3/role_assignments?user.id=b7eb0eb126944cc889ecc6b50bd4cf15&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:32.517084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065efa79-3752-49bd-9219-4e41ce02c07a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:32.517518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065efa79-3752-49bd-9219-4e41ce02c07a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:32.517744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065efa79-3752-49bd-9219-4e41ce02c07a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:32.519476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 145/295] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:32.526231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b224f6-a5c5-43bc-9a54-22b86dfc1c62 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:32.526744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b224f6-a5c5-43bc-9a54-22b86dfc1c62 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:32.526831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b224f6-a5c5-43bc-9a54-22b86dfc1c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:32.545621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-86b224f6-a5c5-43bc-9a54-22b86dfc1c62 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:32.546834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-86b224f6-a5c5-43bc-9a54-22b86dfc1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:32.615148 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:32.636477 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 151/296] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:32.659832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065efa79-3752-49bd-9219-4e41ce02c07a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:32.709085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:32.733123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2af95-6fad-4db8-b3c1-1c32774185a6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:32.733456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2af95-6fad-4db8-b3c1-1c32774185a6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:32.736100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2af95-6fad-4db8-b3c1-1c32774185a6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:32.737531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 152/297] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:32.748800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dbf0e-d9c5-401c-9b31-480b90946278 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:32.749100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dbf0e-d9c5-401c-9b31-480b90946278 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:32.749372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dbf0e-d9c5-401c-9b31-480b90946278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:32.773992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-034dbf0e-d9c5-401c-9b31-480b90946278 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:32.775203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-034dbf0e-d9c5-401c-9b31-480b90946278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:32.802872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065efa79-3752-49bd-9219-4e41ce02c07a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:32.850151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f787fd-3425-450e-afe5-854d4a569106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:32.851054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f787fd-3425-450e-afe5-854d4a569106 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:32.851337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f787fd-3425-450e-afe5-854d4a569106 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:32.851613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f787fd-3425-450e-afe5-854d4a569106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:32.852866 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f787fd-3425-450e-afe5-854d4a569106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:32.854434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f787fd-3425-450e-afe5-854d4a569106 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:32.856332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 146/298] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:32.861956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f787fd-3425-450e-afe5-854d4a569106 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:32.863009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 153/299] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:32.891364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dbf0e-d9c5-401c-9b31-480b90946278 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:33.058955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f787fd-3425-450e-afe5-854d4a569106 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:33.070184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:33.102344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dbf0e-d9c5-401c-9b31-480b90946278 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:33.120236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:33.140701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b03745-6044-4eb9-b7a1-dd9a5ac74750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:33.141118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b03745-6044-4eb9-b7a1-dd9a5ac74750 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.141405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b03745-6044-4eb9-b7a1-dd9a5ac74750 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.141734 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b03745-6044-4eb9-b7a1-dd9a5ac74750 None admin] PATH_INFO: `/v3/groups` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.142576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b03745-6044-4eb9-b7a1-dd9a5ac74750 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:33.143930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b03745-6044-4eb9-b7a1-dd9a5ac74750 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:33.154177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef8faa-bb2f-4ba9-95a8-e3fdf2aa21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:33.156083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef8faa-bb2f-4ba9-95a8-e3fdf2aa21b5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.156659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef8faa-bb2f-4ba9-95a8-e3fdf2aa21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.157154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef8faa-bb2f-4ba9-95a8-e3fdf2aa21b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.174503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef8faa-bb2f-4ba9-95a8-e3fdf2aa21b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:33.175656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 147/300] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Jun 8 12:45:32 2022] POST /identity/v3/groups => generated 229 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f4ef8faa-bb2f-4ba9-95a8-e3fdf2aa21b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:33.185785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:33.186769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:33.187615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:33.192160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 154/301] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:33.210134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b03745-6044-4eb9-b7a1-dd9a5ac74750 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:33.230156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1ac05-6f3a-43e1-8d01-e9a0b102f620 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.230916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1ac05-6f3a-43e1-8d01-e9a0b102f620 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.231403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1ac05-6f3a-43e1-8d01-e9a0b102f620 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.233469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 155/302] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:33.248019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331435-eede-45cd-bf76-a7ab9853905c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.248645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331435-eede-45cd-bf76-a7ab9853905c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.249384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331435-eede-45cd-bf76-a7ab9853905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.275866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-80331435-eede-45cd-bf76-a7ab9853905c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:33.278764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-80331435-eede-45cd-bf76-a7ab9853905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:33.368366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 156/303] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:33.395490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331435-eede-45cd-bf76-a7ab9853905c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:33.413493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b03745-6044-4eb9-b7a1-dd9a5ac74750 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:33.480876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:33.482158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.482158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.482158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.483208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:33.483208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:33.484611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:33.502689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 148/304] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:33.510038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:33.551399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:33.580661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331435-eede-45cd-bf76-a7ab9853905c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:33.583322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:33.621315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da32f7-8d80-4900-b920-fc41082927f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:33.622093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da32f7-8d80-4900-b920-fc41082927f6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.622385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da32f7-8d80-4900-b920-fc41082927f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.622669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da32f7-8d80-4900-b920-fc41082927f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.635384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da32f7-8d80-4900-b920-fc41082927f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:33.639151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755ca6c-8af7-4234-8d7e-06dcf9a100a4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e7da32f7-8d80-4900-b920-fc41082927f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:33.643617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:33.644576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:33.645375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:33.649772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 157/305] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:33.651211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fda708-e8b7-44c8-aa2e-4d25e6a45b01 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.651504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fda708-e8b7-44c8-aa2e-4d25e6a45b01 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.651789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fda708-e8b7-44c8-aa2e-4d25e6a45b01 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.653360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 158/306] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:33.654246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fda708-e8b7-44c8-aa2e-4d25e6a45b01 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:33.683773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9fcfb-6973-4769-b320-3a5c26bfc0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:33.684670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fcfb-6973-4769-b320-3a5c26bfc0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.684960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fcfb-6973-4769-b320-3a5c26bfc0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.685250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fcfb-6973-4769-b320-3a5c26bfc0a2 None admin] PATH_INFO: `/v3/users/433fce116b5e4e909991e9b4d19a5600` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.710026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9fcfb-6973-4769-b320-3a5c26bfc0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=433fce116b5e4e909991e9b4d19a5600)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:33.711736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9fcfb-6973-4769-b320-3a5c26bfc0a2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:33.713483 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 149/307] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:33 2022] GET /identity/v3/users/433fce116b5e4e909991e9b4d19a5600 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:33.718221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf69b62-7bed-4727-83dd-fffff643a474 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.718221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf69b62-7bed-4727-83dd-fffff643a474 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.718221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf69b62-7bed-4727-83dd-fffff643a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.735871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9cf69b62-7bed-4727-83dd-fffff643a474 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:33.737195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9cf69b62-7bed-4727-83dd-fffff643a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:33.798458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fda708-e8b7-44c8-aa2e-4d25e6a45b01 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:33.834921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 150/308] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:33.834921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf69b62-7bed-4727-83dd-fffff643a474 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:33.850734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:33.852143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:33.852572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:33.853096 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:33.854230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:33.854775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:33.856388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:33.867976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:33.869601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 159/309] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:33.870372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:33.915720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:33.984576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf69b62-7bed-4727-83dd-fffff643a474 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:34.003301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4925a-c303-4ecf-889b-f1caf705a387 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:34.030260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:34.030938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:34.031220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:34.031494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:34.032340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] RBAC: Adding query filter params (role.id=c55bd507a50c4e61b27c205ea173975b, user.id=433fce116b5e4e909991e9b4d19a5600, scope.system=all) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:34.032656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:34.034404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:34.042503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 151/310] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Jun 8 12:45:33 2022] GET /identity/v3/role_assignments?user.id=433fce116b5e4e909991e9b4d19a5600&scope.system=all&role.id=c55bd507a50c4e61b27c205ea173975b => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:34.043370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:34.065239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56090c5-5896-4403-9e7a-f848bbc9cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:34.066960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56090c5-5896-4403-9e7a-f848bbc9cc9c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:34.068417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56090c5-5896-4403-9e7a-f848bbc9cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:34.068884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56090c5-5896-4403-9e7a-f848bbc9cc9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:34.087540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56090c5-5896-4403-9e7a-f848bbc9cc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a56090c5-5896-4403-9e7a-f848bbc9cc9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:34.098765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:34.101067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:34.102164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:34.109209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 160/311] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:34.115775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56090c5-5896-4403-9e7a-f848bbc9cc9c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:34.183105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:34.212373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f740-0a26-48b5-a29e-bb4b333404f5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:34.239093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:34.258188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56090c5-5896-4403-9e7a-f848bbc9cc9c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:34.260225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924306a-49fe-4379-b199-3b80712f9054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:34.261395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924306a-49fe-4379-b199-3b80712f9054 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:34.261867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924306a-49fe-4379-b199-3b80712f9054 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:34.262302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924306a-49fe-4379-b199-3b80712f9054 None admin] PATH_INFO: `/v3/users/7a04286c2e1d4054a427d41f395ea014` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:34.263742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924306a-49fe-4379-b199-3b80712f9054 None admin] RBAC: Authorizing `identity:get_user(user_id=7a04286c2e1d4054a427d41f395ea014)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:34.265355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924306a-49fe-4379-b199-3b80712f9054 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:34.267631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 152/312] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:34 2022] GET /identity/v3/users/7a04286c2e1d4054a427d41f395ea014 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:34.274438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924306a-49fe-4379-b199-3b80712f9054 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:34.298071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:34.298883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:34.299281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:34.299669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:34.300564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:34.300987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:34.302585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:34.316902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 161/313] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:34.318563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:34.400405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924306a-49fe-4379-b199-3b80712f9054 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:34.436335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec5b7d-5c66-458c-a51c-842c7f2cc1c0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:34.448652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79645a-9854-4dca-bebb-bbe760bd7d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:34.449987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79645a-9854-4dca-bebb-bbe760bd7d35 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:34.450430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79645a-9854-4dca-bebb-bbe760bd7d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:34.450895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79645a-9854-4dca-bebb-bbe760bd7d35 None admin] PATH_INFO: `/v3/system/users/7a04286c2e1d4054a427d41f395ea014/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:34.452830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79645a-9854-4dca-bebb-bbe760bd7d35 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a04286c2e1d4054a427d41f395ea014, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:34.454562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79645a-9854-4dca-bebb-bbe760bd7d35 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:34.469332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 153/314] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Jun 8 12:45:34 2022] PUT /identity/v3/system/users/7a04286c2e1d4054a427d41f395ea014/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:34.488289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1dd4a-fc37-4358-8aa3-76c4c1ca0dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:34.489790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1dd4a-fc37-4358-8aa3-76c4c1ca0dbb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:34.490281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1dd4a-fc37-4358-8aa3-76c4c1ca0dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:34.490748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1dd4a-fc37-4358-8aa3-76c4c1ca0dbb None admin] PATH_INFO: `/v3/users/3cb3482609ce464c948378f14a7b48c4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:34.492915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1dd4a-fc37-4358-8aa3-76c4c1ca0dbb None admin] RBAC: Authorizing `identity:get_user(user_id=3cb3482609ce464c948378f14a7b48c4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:34.494722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1dd4a-fc37-4358-8aa3-76c4c1ca0dbb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:34.497347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 162/315] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:34 2022] GET /identity/v3/users/3cb3482609ce464c948378f14a7b48c4 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:34.503103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79645a-9854-4dca-bebb-bbe760bd7d35 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:34.527120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:34.635734 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79645a-9854-4dca-bebb-bbe760bd7d35 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:34.677211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6799e5f-c2fc-438c-a78d-e5825978b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:34.677946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799e5f-c2fc-438c-a78d-e5825978b839 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:34.678329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799e5f-c2fc-438c-a78d-e5825978b839 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:34.678673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799e5f-c2fc-438c-a78d-e5825978b839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:34.763713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6799e5f-c2fc-438c-a78d-e5825978b839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:34.765152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6799e5f-c2fc-438c-a78d-e5825978b839 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:34.784027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:34.887809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 154/316] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:34.893258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1dd4a-fc37-4358-8aa3-76c4c1ca0dbb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:34.915602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:35.015560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1dd4a-fc37-4358-8aa3-76c4c1ca0dbb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:35.059043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e73c9-a919-4d24-a8c4-4f94cd8040c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:35.060441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e73c9-a919-4d24-a8c4-4f94cd8040c5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:35.060736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e73c9-a919-4d24-a8c4-4f94cd8040c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:35.061025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e73c9-a919-4d24-a8c4-4f94cd8040c5 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:35.062438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e73c9-a919-4d24-a8c4-4f94cd8040c5 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:35.064520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e73c9-a919-4d24-a8c4-4f94cd8040c5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:35.068234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 163/317] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:34 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:35.075665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6799e5f-c2fc-438c-a78d-e5825978b839 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:35.206286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6799e5f-c2fc-438c-a78d-e5825978b839 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:35.227245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:35.260737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012894-070d-4910-ace7-38923d1f18cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:35.261804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012894-070d-4910-ace7-38923d1f18cb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:35.262306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012894-070d-4910-ace7-38923d1f18cb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:35.262776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012894-070d-4910-ace7-38923d1f18cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:35.263917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012894-070d-4910-ace7-38923d1f18cb None admin] RBAC: Adding query filter params (role.id=c55bd507a50c4e61b27c205ea173975b, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9, user.id=3cb3482609ce464c948378f14a7b48c4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:35.264434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012894-070d-4910-ace7-38923d1f18cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:35.266650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012894-070d-4910-ace7-38923d1f18cb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:35.275106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 155/318] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:45:35 2022] GET /identity/v3/role_assignments?user.id=3cb3482609ce464c948378f14a7b48c4&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=c55bd507a50c4e61b27c205ea173975b => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:35.807303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6f9c4-b7f8-4f85-973a-db8c4e2064c0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:35.807727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6f9c4-b7f8-4f85-973a-db8c4e2064c0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:35.807904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6f9c4-b7f8-4f85-973a-db8c4e2064c0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:35.809480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 164/319] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:35.815356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1632-621c-424a-b13b-ecb97a00ed5b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:35.815863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1632-621c-424a-b13b-ecb97a00ed5b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:35.815967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1632-621c-424a-b13b-ecb97a00ed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:35.834086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b85d1632-621c-424a-b13b-ecb97a00ed5b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:35.835485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b85d1632-621c-424a-b13b-ecb97a00ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:35.908767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 156/320] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:35.932746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6f9c4-b7f8-4f85-973a-db8c4e2064c0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:36.041464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:36.062420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6f9c4-b7f8-4f85-973a-db8c4e2064c0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:36.104392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2036b26-940e-40c0-920b-bc9bd7899ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:36.105489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2036b26-940e-40c0-920b-bc9bd7899ffe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:36.105977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2036b26-940e-40c0-920b-bc9bd7899ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:36.106480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2036b26-940e-40c0-920b-bc9bd7899ffe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:36.108397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2036b26-940e-40c0-920b-bc9bd7899ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:36.110452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2036b26-940e-40c0-920b-bc9bd7899ffe None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:36.112620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 165/321] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:36.119468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d1632-621c-424a-b13b-ecb97a00ed5b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:36.230438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d1632-621c-424a-b13b-ecb97a00ed5b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:36.239113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:36.277397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98c9c6-dbcf-4106-a434-44691218c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:36.278116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c9c6-dbcf-4106-a434-44691218c65d None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:36.278406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c9c6-dbcf-4106-a434-44691218c65d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:36.278689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c9c6-dbcf-4106-a434-44691218c65d None admin] PATH_INFO: `/v3/groups` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:36.279401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98c9c6-dbcf-4106-a434-44691218c65d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:36.280857 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98c9c6-dbcf-4106-a434-44691218c65d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:36.305574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 157/322] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Jun 8 12:45:36 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:36.499822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc9dc-76d3-489d-b29a-cc92993ec34f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:36.500187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc9dc-76d3-489d-b29a-cc92993ec34f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:36.500395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc9dc-76d3-489d-b29a-cc92993ec34f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:36.501986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 166/323] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:36.507621 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d8b6-ab81-4f6e-9077-bd5e2bf152ee None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:36.507920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d8b6-ab81-4f6e-9077-bd5e2bf152ee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:36.509012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d8b6-ab81-4f6e-9077-bd5e2bf152ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:36.528902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-aae6d8b6-ab81-4f6e-9077-bd5e2bf152ee None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:36.530154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aae6d8b6-ab81-4f6e-9077-bd5e2bf152ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:36.621915 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 158/324] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:36.650686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cc9dc-76d3-489d-b29a-cc92993ec34f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:36.815159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cc9dc-76d3-489d-b29a-cc92993ec34f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:36.856687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6d528-58f0-4b96-89a5-a16bd8bb6b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:36.857909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d528-58f0-4b96-89a5-a16bd8bb6b49 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:36.858393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d528-58f0-4b96-89a5-a16bd8bb6b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:36.858940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d528-58f0-4b96-89a5-a16bd8bb6b49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:36.872407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6d528-58f0-4b96-89a5-a16bd8bb6b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fca6d528-58f0-4b96-89a5-a16bd8bb6b49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:36.881816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:36.882718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:36.883493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:36.886305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 167/325] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:36.892283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d8b6-ab81-4f6e-9077-bd5e2bf152ee None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:37.014076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:37.025110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d8b6-ab81-4f6e-9077-bd5e2bf152ee None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:37.049653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23eaa-aca6-493a-ba6c-b34a35101ec6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:37.050595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23eaa-aca6-493a-ba6c-b34a35101ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:37.051070 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23eaa-aca6-493a-ba6c-b34a35101ec6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:37.054039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 168/326] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:37.059994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77f5f-5ff1-4fe0-8d41-1347a1e38c07 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:37.060759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77f5f-5ff1-4fe0-8d41-1347a1e38c07 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:37.061240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77f5f-5ff1-4fe0-8d41-1347a1e38c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:37.078275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:37.078968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:37.079262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:37.079545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:37.080311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:37.080625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:37.082345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5db77f5f-5ff1-4fe0-8d41-1347a1e38c07 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:37.082664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:37.085300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5db77f5f-5ff1-4fe0-8d41-1347a1e38c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:37.095249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:37.097435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 159/327] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:37.115970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:37.197041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 169/328] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:37.226477 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77f5f-5ff1-4fe0-8d41-1347a1e38c07 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:37.262481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21121fd-0842-42f5-8b50-b818346f5dcb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:37.312420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09afc3-e854-41cb-b2c9-e9a922d9394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:37.313349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09afc3-e854-41cb-b2c9-e9a922d9394a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:37.313713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09afc3-e854-41cb-b2c9-e9a922d9394a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:37.314001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09afc3-e854-41cb-b2c9-e9a922d9394a None admin] PATH_INFO: `/v3/users/433fce116b5e4e909991e9b4d19a5600` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:37.315990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09afc3-e854-41cb-b2c9-e9a922d9394a None admin] RBAC: Authorizing `identity:get_user(user_id=433fce116b5e4e909991e9b4d19a5600)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:37.318955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09afc3-e854-41cb-b2c9-e9a922d9394a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:37.319946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 160/329] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:37 2022] GET /identity/v3/users/433fce116b5e4e909991e9b4d19a5600 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:37.333424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09afc3-e854-41cb-b2c9-e9a922d9394a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:37.368520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:37.386268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77f5f-5ff1-4fe0-8d41-1347a1e38c07 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:37.447745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04882979-6721-4e3d-8202-5cb75f95b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:37.448326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04882979-6721-4e3d-8202-5cb75f95b394 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:37.448618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04882979-6721-4e3d-8202-5cb75f95b394 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:37.448905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04882979-6721-4e3d-8202-5cb75f95b394 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:37.457939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09afc3-e854-41cb-b2c9-e9a922d9394a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:37.471633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04882979-6721-4e3d-8202-5cb75f95b394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-04882979-6721-4e3d-8202-5cb75f95b394 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:37.488342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:37.489353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:37.490668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:37.492306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 170/330] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:37.499275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04882979-6721-4e3d-8202-5cb75f95b394 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:37.505740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0840-c4a4-4b9d-9e3c-119f1a3bc749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:37.507362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0840-c4a4-4b9d-9e3c-119f1a3bc749 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:37.507877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0840-c4a4-4b9d-9e3c-119f1a3bc749 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:37.508348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0840-c4a4-4b9d-9e3c-119f1a3bc749 None admin] PATH_INFO: `/v3/system/users/433fce116b5e4e909991e9b4d19a5600/roles/c55bd507a50c4e61b27c205ea173975b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:37.510312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e0840-c4a4-4b9d-9e3c-119f1a3bc749 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=433fce116b5e4e909991e9b4d19a5600, role_id=c55bd507a50c4e61b27c205ea173975b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:37.511943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e0840-c4a4-4b9d-9e3c-119f1a3bc749 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:37.512462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:37.540012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 161/331] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Jun 8 12:45:37 2022] PUT /identity/v3/system/users/433fce116b5e4e909991e9b4d19a5600/roles/c55bd507a50c4e61b27c205ea173975b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:37.635815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04882979-6721-4e3d-8202-5cb75f95b394 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:37.675088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:37.675806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:37.676098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:37.676385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:37.677261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:37.677619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:37.679058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:37.688796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 171/332] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:37.695682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0840-c4a4-4b9d-9e3c-119f1a3bc749 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:37.883649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:37.893941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0840-c4a4-4b9d-9e3c-119f1a3bc749 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:37.941775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294661ac-b039-47e4-afe1-5f0b08032afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:37.943010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294661ac-b039-47e4-afe1-5f0b08032afe None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:37.943301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294661ac-b039-47e4-afe1-5f0b08032afe None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:37.943576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294661ac-b039-47e4-afe1-5f0b08032afe None admin] PATH_INFO: `/v3/users/7a04286c2e1d4054a427d41f395ea014` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:37.945078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294661ac-b039-47e4-afe1-5f0b08032afe None admin] RBAC: Authorizing `identity:get_user(user_id=7a04286c2e1d4054a427d41f395ea014)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:37.946650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294661ac-b039-47e4-afe1-5f0b08032afe None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:37.948713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 162/333] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:37 2022] GET /identity/v3/users/7a04286c2e1d4054a427d41f395ea014 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:37.954946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:38.062116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:38.107114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9baf8c-3969-47ab-ad18-fe3695c406bc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:38.145425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bccee9-4d52-45d7-8374-b959232de776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:38.146517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bccee9-4d52-45d7-8374-b959232de776 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:38.147052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bccee9-4d52-45d7-8374-b959232de776 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:38.147625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bccee9-4d52-45d7-8374-b959232de776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:38.148692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bccee9-4d52-45d7-8374-b959232de776 None admin] RBAC: Adding query filter params (role.id=a73bec0a8208424e89eba3acdec2e49a, user.id=7a04286c2e1d4054a427d41f395ea014, scope.system=all) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:38.149211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bccee9-4d52-45d7-8374-b959232de776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:38.150924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bccee9-4d52-45d7-8374-b959232de776 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:38.165772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 172/334] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Jun 8 12:45:37 2022] GET /identity/v3/role_assignments?user.id=7a04286c2e1d4054a427d41f395ea014&scope.system=all&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:39.863051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735dca1-2415-4e19-ac42-c06f299d459b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:39.864025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735dca1-2415-4e19-ac42-c06f299d459b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:39.864623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735dca1-2415-4e19-ac42-c06f299d459b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:39.866842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 163/335] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:39.879241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd354-4b19-4028-9e97-d9c636891eec None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:39.880748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd354-4b19-4028-9e97-d9c636891eec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:39.881236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd354-4b19-4028-9e97-d9c636891eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:39.901037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e44fd354-4b19-4028-9e97-d9c636891eec None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:39.902867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e44fd354-4b19-4028-9e97-d9c636891eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:39.914456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645caa6-99b8-4875-b8d9-78f726d42e82 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:39.915085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645caa6-99b8-4875-b8d9-78f726d42e82 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:39.915561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645caa6-99b8-4875-b8d9-78f726d42e82 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:39.917438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 164/336] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:39.927889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25cc2a-9691-4f01-9442-44f7eb067d2e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:39.928515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25cc2a-9691-4f01-9442-44f7eb067d2e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:39.929009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25cc2a-9691-4f01-9442-44f7eb067d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:39.956527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1a25cc2a-9691-4f01-9442-44f7eb067d2e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:39.958646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1a25cc2a-9691-4f01-9442-44f7eb067d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:39.987416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 173/337] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:40.032698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fd354-4b19-4028-9e97-d9c636891eec None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:40.084320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 165/338] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:40.110065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:40.130515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25cc2a-9691-4f01-9442-44f7eb067d2e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:40.187057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fd354-4b19-4028-9e97-d9c636891eec None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:40.276468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d2018-b67b-4e62-b1fa-a329ebd8eec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:40.277712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d2018-b67b-4e62-b1fa-a329ebd8eec4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:40.278199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d2018-b67b-4e62-b1fa-a329ebd8eec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:40.278673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d2018-b67b-4e62-b1fa-a329ebd8eec4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:40.308856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d2018-b67b-4e62-b1fa-a329ebd8eec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-985d2018-b67b-4e62-b1fa-a329ebd8eec4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:40.317323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:40.318277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:40.319080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:40.326093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 174/339] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:40.338068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d2018-b67b-4e62-b1fa-a329ebd8eec4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:40.383673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:40.447777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25cc2a-9691-4f01-9442-44f7eb067d2e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:40.550773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0c533-4603-4ec7-9c5f-eed43b262645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:40.552125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0c533-4603-4ec7-9c5f-eed43b262645 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:40.553427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0c533-4603-4ec7-9c5f-eed43b262645 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:40.553995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0c533-4603-4ec7-9c5f-eed43b262645 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:40.568141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0c533-4603-4ec7-9c5f-eed43b262645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-31b0c533-4603-4ec7-9c5f-eed43b262645 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:40.579799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:40.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:40.582282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:40.586496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 166/340] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:40.588374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa160-6faf-46b0-ba0b-7f3eee07d072 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:40.588872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa160-6faf-46b0-ba0b-7f3eee07d072 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:40.589373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa160-6faf-46b0-ba0b-7f3eee07d072 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:40.591133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 167/341] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:40.594566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aa160-6faf-46b0-ba0b-7f3eee07d072 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:40.610753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d2018-b67b-4e62-b1fa-a329ebd8eec4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:40.638014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:40.673403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8147f-5dc0-48e6-bb10-a84b0748fe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:40.674123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8147f-5dc0-48e6-bb10-a84b0748fe12 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:40.674417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8147f-5dc0-48e6-bb10-a84b0748fe12 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:40.674704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8147f-5dc0-48e6-bb10-a84b0748fe12 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:40.675477 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8147f-5dc0-48e6-bb10-a84b0748fe12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:40.675792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8147f-5dc0-48e6-bb10-a84b0748fe12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:40.677513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8147f-5dc0-48e6-bb10-a84b0748fe12 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:40.691776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 175/342] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:40.695440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c9148-b2a3-41c6-8e75-9410d636de75 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:40.696267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c9148-b2a3-41c6-8e75-9410d636de75 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:40.697038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c9148-b2a3-41c6-8e75-9410d636de75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:40.743577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-100c9148-b2a3-41c6-8e75-9410d636de75 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:40.745819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-100c9148-b2a3-41c6-8e75-9410d636de75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:40.785563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aa160-6faf-46b0-ba0b-7f3eee07d072 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:40.847889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:40.848693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:40.849147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:40.850760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:40.851553 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:40.851874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:40.853279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:40.874936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 168/343] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:40.875808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:40.901688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 176/344] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:40.902480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c9148-b2a3-41c6-8e75-9410d636de75 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:40.904824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:41.070259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac003c9-29a9-44b0-a616-7a95d961b525 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:41.077957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c9148-b2a3-41c6-8e75-9410d636de75 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:41.081343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:41.121824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecbd02-2ba2-4d88-9fff-15de46e5665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:41.122766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecbd02-2ba2-4d88-9fff-15de46e5665b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.123083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecbd02-2ba2-4d88-9fff-15de46e5665b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.123792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecbd02-2ba2-4d88-9fff-15de46e5665b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.129031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813c284-fd82-462d-9c4a-1f719b2782b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:41.129798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813c284-fd82-462d-9c4a-1f719b2782b5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.130610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813c284-fd82-462d-9c4a-1f719b2782b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.130905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813c284-fd82-462d-9c4a-1f719b2782b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.217709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813c284-fd82-462d-9c4a-1f719b2782b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:41.219144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813c284-fd82-462d-9c4a-1f719b2782b5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:41.221589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecbd02-2ba2-4d88-9fff-15de46e5665b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:41.223071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecbd02-2ba2-4d88-9fff-15de46e5665b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:41.240832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:41.340757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 177/345] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:41.341660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813c284-fd82-462d-9c4a-1f719b2782b5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:41.345057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:41.355425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 169/346] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:41.357237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cafee-d7d2-4ba5-bb33-ea0d5213d20d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.362003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cafee-d7d2-4ba5-bb33-ea0d5213d20d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.362636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cafee-d7d2-4ba5-bb33-ea0d5213d20d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.364701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 170/347] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:41.365857 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cafee-d7d2-4ba5-bb33-ea0d5213d20d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:41.474684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813c284-fd82-462d-9c4a-1f719b2782b5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:41.497808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cafee-d7d2-4ba5-bb33-ea0d5213d20d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:41.512737 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb18a6-d3c7-450d-823c-485cccbf1c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:41.513594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb18a6-d3c7-450d-823c-485cccbf1c8c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.514112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb18a6-d3c7-450d-823c-485cccbf1c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.514216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:41.514293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb18a6-d3c7-450d-823c-485cccbf1c8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.527247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb18a6-d3c7-450d-823c-485cccbf1c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c3eb18a6-d3c7-450d-823c-485cccbf1c8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:41.535576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:41.536787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:41.538282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 178/348] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:41.538965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb18a6-d3c7-450d-823c-485cccbf1c8c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:41.541479 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd903c0e-2e72-43ea-bda8-c2aa6a44be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:41.542712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903c0e-2e72-43ea-bda8-c2aa6a44be50 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.543193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903c0e-2e72-43ea-bda8-c2aa6a44be50 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.543677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903c0e-2e72-43ea-bda8-c2aa6a44be50 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.545276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd903c0e-2e72-43ea-bda8-c2aa6a44be50 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:41.547022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd903c0e-2e72-43ea-bda8-c2aa6a44be50 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:41.548993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 171/349] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:41 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:41.550515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646e082-a670-486b-be4a-712efa1ab207 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.551102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646e082-a670-486b-be4a-712efa1ab207 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.552206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646e082-a670-486b-be4a-712efa1ab207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.570619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0646e082-a670-486b-be4a-712efa1ab207 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:41.572226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0646e082-a670-486b-be4a-712efa1ab207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:41.616248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:41.654292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 172/350] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:41.655663 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646e082-a670-486b-be4a-712efa1ab207 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:41.665605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb18a6-d3c7-450d-823c-485cccbf1c8c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:41.697888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2d538-a25b-4766-ad48-721bcbaa22b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:41.698772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2d538-a25b-4766-ad48-721bcbaa22b3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.699064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2d538-a25b-4766-ad48-721bcbaa22b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.699727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2d538-a25b-4766-ad48-721bcbaa22b3 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.700616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2d538-a25b-4766-ad48-721bcbaa22b3 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:41.702117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2d538-a25b-4766-ad48-721bcbaa22b3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:41.704082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 179/351] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:41 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:41.704637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2d538-a25b-4766-ad48-721bcbaa22b3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:41.811186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646e082-a670-486b-be4a-712efa1ab207 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:41.828713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2d538-a25b-4766-ad48-721bcbaa22b3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:41.832080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:41.854747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:41.855539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.855982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.856278 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.857425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:41.857803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:41.859218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:41.864317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:41.871811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794d0e1-7e5f-45b0-a8c5-60bfc8f6463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:41.871994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 173/352] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:41.872880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:41.874519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794d0e1-7e5f-45b0-a8c5-60bfc8f6463d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:41.874811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794d0e1-7e5f-45b0-a8c5-60bfc8f6463d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:41.875095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794d0e1-7e5f-45b0-a8c5-60bfc8f6463d None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:41.883979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794d0e1-7e5f-45b0-a8c5-60bfc8f6463d None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:41.885469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794d0e1-7e5f-45b0-a8c5-60bfc8f6463d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:41.887248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 180/353] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:41 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:41.888032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794d0e1-7e5f-45b0-a8c5-60bfc8f6463d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:42.004677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433318c-a098-442f-bf1d-1e0d7a84da14 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:42.019782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794d0e1-7e5f-45b0-a8c5-60bfc8f6463d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:42.057361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923181-6243-4427-be9a-a0537aa57c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:42.057877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923181-6243-4427-be9a-a0537aa57c58 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.058169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923181-6243-4427-be9a-a0537aa57c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.058447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923181-6243-4427-be9a-a0537aa57c58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.065385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6ee59-cd6d-441c-a7b9-261ddbd6b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:42.066210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ee59-cd6d-441c-a7b9-261ddbd6b125 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.066494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ee59-cd6d-441c-a7b9-261ddbd6b125 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.066777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ee59-cd6d-441c-a7b9-261ddbd6b125 None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.068593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6ee59-cd6d-441c-a7b9-261ddbd6b125 None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:42.070134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6ee59-cd6d-441c-a7b9-261ddbd6b125 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:42.071219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54923181-6243-4427-be9a-a0537aa57c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:42.071797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 181/354] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:41 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:42.073027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeb84d-de7b-40ba-af1b-3afda53a4f9b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.073316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeb84d-de7b-40ba-af1b-3afda53a4f9b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.073637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeb84d-de7b-40ba-af1b-3afda53a4f9b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.075022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 182/355] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:42.075718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeb84d-de7b-40ba-af1b-3afda53a4f9b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-54923181-6243-4427-be9a-a0537aa57c58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:42.084169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:42.085200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:42.086047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 174/356] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:42.087824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923181-6243-4427-be9a-a0537aa57c58 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:42.127787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:42.162189 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:42.212133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923181-6243-4427-be9a-a0537aa57c58 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:42.215503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeb84d-de7b-40ba-af1b-3afda53a4f9b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:42.253294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66e20-0257-4e07-bc4e-08d712fefbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:42.254007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66e20-0257-4e07-bc4e-08d712fefbce None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.254296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66e20-0257-4e07-bc4e-08d712fefbce None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.254582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66e20-0257-4e07-bc4e-08d712fefbce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.256075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b66e20-0257-4e07-bc4e-08d712fefbce None admin] RBAC: Adding query filter params (group.id=636f35956e2e40ff9942d412cc4a2851, role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=b569a1d3ddb44429977459c3b6277206) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:42.256244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bb468-9dc4-4ad4-a260-4a13d6985c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:42.256489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b66e20-0257-4e07-bc4e-08d712fefbce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:42.258404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb468-9dc4-4ad4-a260-4a13d6985c93 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.258404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb468-9dc4-4ad4-a260-4a13d6985c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.258404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb468-9dc4-4ad4-a260-4a13d6985c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.258618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b66e20-0257-4e07-bc4e-08d712fefbce None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:42.264155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 175/357] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:42 2022] GET /identity/v3/role_assignments?group.id=636f35956e2e40ff9942d412cc4a2851&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=025cadb68d6641098d3edb9e47910aaf => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:42.266491 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24eb40-611e-4e71-905e-6efeee58f9e8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.266794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24eb40-611e-4e71-905e-6efeee58f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.267079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24eb40-611e-4e71-905e-6efeee58f9e8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.268705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 176/358] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:42.269328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24eb40-611e-4e71-905e-6efeee58f9e8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:42.360372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bb468-9dc4-4ad4-a260-4a13d6985c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:42.362080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bb468-9dc4-4ad4-a260-4a13d6985c93 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:42.410596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:42.424121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24eb40-611e-4e71-905e-6efeee58f9e8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:42.456685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:42.490881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6884cf3-e276-4011-aa93-abe987448719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:42.492106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884cf3-e276-4011-aa93-abe987448719 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.492389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884cf3-e276-4011-aa93-abe987448719 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.494046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884cf3-e276-4011-aa93-abe987448719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.494046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6884cf3-e276-4011-aa93-abe987448719 None admin] RBAC: Adding query filter params (group.id=636f35956e2e40ff9942d412cc4a2851, role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=b569a1d3ddb44429977459c3b6277206) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:42.494046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6884cf3-e276-4011-aa93-abe987448719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:42.495452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6884cf3-e276-4011-aa93-abe987448719 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:42.503950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 177/359] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:42 2022] GET /identity/v3/role_assignments?group.id=636f35956e2e40ff9942d412cc4a2851&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:42.506048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d1451-2acd-48ea-a99b-09c65193c389 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.506340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d1451-2acd-48ea-a99b-09c65193c389 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.506628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d1451-2acd-48ea-a99b-09c65193c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.522355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 183/360] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:42.523379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bb468-9dc4-4ad4-a260-4a13d6985c93 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:42.542752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b74d1451-2acd-48ea-a99b-09c65193c389 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:42.543972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b74d1451-2acd-48ea-a99b-09c65193c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:42.645858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 178/361] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:42.647369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c5f6-585a-422c-97f2-e3350fbc1836 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.647746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c5f6-585a-422c-97f2-e3350fbc1836 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.648033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c5f6-585a-422c-97f2-e3350fbc1836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.672488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bb468-9dc4-4ad4-a260-4a13d6985c93 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:42.684165 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d1b1c5f6-585a-422c-97f2-e3350fbc1836 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:42.685636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d1b1c5f6-585a-422c-97f2-e3350fbc1836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:42.722606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:42.723304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.724933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.725260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.726966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:42.727396 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:42.729125 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:42.742844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 184/362] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:42.743736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:42.786467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:42.797930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 179/363] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:42.798822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c5f6-585a-422c-97f2-e3350fbc1836 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:42.841576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:42.913511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb34d4-84da-4229-88cd-5a5f95e23813 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:42.938909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c5f6-585a-422c-97f2-e3350fbc1836 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:42.965339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a89bc-2ad4-4c8c-9155-9b3273feb68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:42.967205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a89bc-2ad4-4c8c-9155-9b3273feb68f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.967700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a89bc-2ad4-4c8c-9155-9b3273feb68f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.968465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a89bc-2ad4-4c8c-9155-9b3273feb68f None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.970652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a89bc-2ad4-4c8c-9155-9b3273feb68f None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:42.972926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a89bc-2ad4-4c8c-9155-9b3273feb68f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:42.976717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 185/364] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:42 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:42.978435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a89bc-2ad4-4c8c-9155-9b3273feb68f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:42.981726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e305d4-d737-4777-98e0-bb9ad762621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:42.982450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e305d4-d737-4777-98e0-bb9ad762621d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:42.982742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e305d4-d737-4777-98e0-bb9ad762621d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:42.983025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e305d4-d737-4777-98e0-bb9ad762621d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:42.996237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e305d4-d737-4777-98e0-bb9ad762621d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-97e305d4-d737-4777-98e0-bb9ad762621d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:43.006765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:43.013280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 180/365] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:43.014251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e305d4-d737-4777-98e0-bb9ad762621d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:43.117975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:43.125618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:43.136203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a89bc-2ad4-4c8c-9155-9b3273feb68f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:43.143424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e305d4-d737-4777-98e0-bb9ad762621d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:43.183510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf0ab5-4cd8-4f88-9eb3-02c9ee220fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:43.184866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0ab5-4cd8-4f88-9eb3-02c9ee220fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:43.185612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0ab5-4cd8-4f88-9eb3-02c9ee220fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:43.186186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0ab5-4cd8-4f88-9eb3-02c9ee220fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:43.189342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e2545-ab6e-42be-b28f-846594986eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:43.190198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e2545-ab6e-42be-b28f-846594986eff None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:43.190484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e2545-ab6e-42be-b28f-846594986eff None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:43.190764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e2545-ab6e-42be-b28f-846594986eff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:43.205897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e2545-ab6e-42be-b28f-846594986eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2b1e2545-ab6e-42be-b28f-846594986eff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:43.218640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:43.219791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:43.220935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 181/366] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:43.221767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e2545-ab6e-42be-b28f-846594986eff None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:43.284573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf0ab5-4cd8-4f88-9eb3-02c9ee220fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:43.286826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf0ab5-4cd8-4f88-9eb3-02c9ee220fa4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:43.366881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e2545-ab6e-42be-b28f-846594986eff None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:43.418629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:43.427312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f89e6-75d0-456e-adb3-93cb57f9a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:43.428317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f89e6-75d0-456e-adb3-93cb57f9a41d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:43.428619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f89e6-75d0-456e-adb3-93cb57f9a41d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:43.428901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f89e6-75d0-456e-adb3-93cb57f9a41d None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:43.432233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 186/367] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:43.436854 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf0ab5-4cd8-4f88-9eb3-02c9ee220fa4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:43.437015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f89e6-75d0-456e-adb3-93cb57f9a41d None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:43.437015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f89e6-75d0-456e-adb3-93cb57f9a41d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:43.440032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 182/368] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:43 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:43.447516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f89e6-75d0-456e-adb3-93cb57f9a41d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:43.459566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:43.584765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf0ab5-4cd8-4f88-9eb3-02c9ee220fa4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:43.595870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f89e6-75d0-456e-adb3-93cb57f9a41d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:43.630432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:43.631783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:43.632269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:43.632864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:43.633973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:43.634475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:43.636264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:43.638506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:43.639199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:43.639512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:43.640198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:43.640535 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:43.640853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:43.642307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:43.649138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 187/369] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:43.650408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:43.656375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 183/370] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:43.656933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:43.726525 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:43.733243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:43.774075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2003e2-e894-455e-88bd-d2fa79f4ad2c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:43.794478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcfe12-f177-48ad-90af-920b0aaade83 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:43.816046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:43.816727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:43.817019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:43.817478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:43.818364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] RBAC: Adding query filter params (group.id=636f35956e2e40ff9942d412cc4a2851, role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:43.818685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:43.820191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:43.831187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 184/371] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:43 2022] GET /identity/v3/role_assignments?group.id=636f35956e2e40ff9942d412cc4a2851&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=025cadb68d6641098d3edb9e47910aaf => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:43.831187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:43.859431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601b80a-d7cb-4ad1-ab9b-1aea9093cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:43.861107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b80a-d7cb-4ad1-ab9b-1aea9093cb24 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:43.861680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b80a-d7cb-4ad1-ab9b-1aea9093cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:43.862161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b80a-d7cb-4ad1-ab9b-1aea9093cb24 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:43.866253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601b80a-d7cb-4ad1-ab9b-1aea9093cb24 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:43.868931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601b80a-d7cb-4ad1-ab9b-1aea9093cb24 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:43.871574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 188/372] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:43 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:43.872781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601b80a-d7cb-4ad1-ab9b-1aea9093cb24 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:44.043571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca7ad8-1179-4d5c-9c35-eef81208357a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:44.060518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601b80a-d7cb-4ad1-ab9b-1aea9093cb24 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:44.087422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c958ae-01a3-4179-8e62-452149db7d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:44.088033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:44.090991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c958ae-01a3-4179-8e62-452149db7d96 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:44.091946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c958ae-01a3-4179-8e62-452149db7d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:44.092675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:44.093635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c958ae-01a3-4179-8e62-452149db7d96 None admin] PATH_INFO: `/v3/users/433fce116b5e4e909991e9b4d19a5600` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:44.095863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c958ae-01a3-4179-8e62-452149db7d96 None admin] RBAC: Authorizing `identity:get_user(user_id=433fce116b5e4e909991e9b4d19a5600)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:44.097594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c958ae-01a3-4179-8e62-452149db7d96 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:44.100725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2455-b01b-42c1-a527-6217155cbb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:44.101408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2455-b01b-42c1-a527-6217155cbb2b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:44.101716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 185/373] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:45:43 2022] GET /identity/v3/users/433fce116b5e4e909991e9b4d19a5600 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:44.101881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2455-b01b-42c1-a527-6217155cbb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:44.102144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2455-b01b-42c1-a527-6217155cbb2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:44.102474 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c958ae-01a3-4179-8e62-452149db7d96 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:44.185843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2455-b01b-42c1-a527-6217155cbb2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:44.187359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2455-b01b-42c1-a527-6217155cbb2b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:44.217121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c958ae-01a3-4179-8e62-452149db7d96 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:44.257215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8976e-91fc-4d6c-a744-751416d2086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:44.258261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8976e-91fc-4d6c-a744-751416d2086c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:44.258617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8976e-91fc-4d6c-a744-751416d2086c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:44.258970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8976e-91fc-4d6c-a744-751416d2086c None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:44.260303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8976e-91fc-4d6c-a744-751416d2086c None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:44.261890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8976e-91fc-4d6c-a744-751416d2086c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:44.263529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 186/374] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:44 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:44.268986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8976e-91fc-4d6c-a744-751416d2086c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:44.300330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 189/375] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:44.301202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2455-b01b-42c1-a527-6217155cbb2b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:44.333959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:44.369836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:44.418521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2455-b01b-42c1-a527-6217155cbb2b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:44.443578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8976e-91fc-4d6c-a744-751416d2086c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:44.463506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:44.464179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:44.464471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:44.464759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:44.465634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] RBAC: Adding query filter params (group.id=636f35956e2e40ff9942d412cc4a2851, role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:44.465960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:44.467409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:44.484122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 190/376] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:44 2022] GET /identity/v3/role_assignments?group.id=636f35956e2e40ff9942d412cc4a2851&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:44.485008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:44.514034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:44.514729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:44.515021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:44.515308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:44.516182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] RBAC: Adding query filter params (role.id=c55bd507a50c4e61b27c205ea173975b, user.id=433fce116b5e4e909991e9b4d19a5600, scope.system=all) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:44.516505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:44.518141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:44.550013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 187/377] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Jun 8 12:45:44 2022] GET /identity/v3/role_assignments?user.id=433fce116b5e4e909991e9b4d19a5600&scope.system=all&role.id=c55bd507a50c4e61b27c205ea173975b => generated 510 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:44.638527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:44.647343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c1eb-779d-482d-8679-97673e063a7b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:44.689598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217c6d-84d5-4b60-973f-dd99b1a27244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:44.690498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217c6d-84d5-4b60-973f-dd99b1a27244 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:44.690788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217c6d-84d5-4b60-973f-dd99b1a27244 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:44.691071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217c6d-84d5-4b60-973f-dd99b1a27244 None admin] PATH_INFO: `/v3/projects/b549cbd5077d4178b499b2510c76f517` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:44.692767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee217c6d-84d5-4b60-973f-dd99b1a27244 None admin] RBAC: Authorizing `identity:get_project(project_id=b549cbd5077d4178b499b2510c76f517)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:44.694367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee217c6d-84d5-4b60-973f-dd99b1a27244 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:44.696505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 191/378] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:44 2022] GET /identity/v3/projects/b549cbd5077d4178b499b2510c76f517 => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:44.704006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:44.847810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66625a8-6dfa-4dca-9ba7-b222bbb958ae None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:44.885944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:44.900417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76400bc3-e8bd-4471-bd7f-341efb4068fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:44.901219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400bc3-e8bd-4471-bd7f-341efb4068fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:44.901508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400bc3-e8bd-4471-bd7f-341efb4068fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:44.901819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400bc3-e8bd-4471-bd7f-341efb4068fd None admin] PATH_INFO: `/v3/groups/1115018ce281471081fc89daba3d1d33` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:44.913391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76400bc3-e8bd-4471-bd7f-341efb4068fd None admin] RBAC: Authorizing `identity:get_group(group_id=1115018ce281471081fc89daba3d1d33)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:44.914967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76400bc3-e8bd-4471-bd7f-341efb4068fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:44.917150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 188/379] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:44 2022] GET /identity/v3/groups/1115018ce281471081fc89daba3d1d33 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:44.922993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217c6d-84d5-4b60-973f-dd99b1a27244 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:45.000275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec71104-4980-4ce5-862e-f2e3c57c964c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:45.000591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec71104-4980-4ce5-862e-f2e3c57c964c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:45.000837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec71104-4980-4ce5-862e-f2e3c57c964c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:45.002402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 189/380] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:45.009691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653668-5086-4781-9f7f-08b47865a01d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:45.010306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653668-5086-4781-9f7f-08b47865a01d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:45.010780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653668-5086-4781-9f7f-08b47865a01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:45.040414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7d653668-5086-4781-9f7f-08b47865a01d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:45.046411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d653668-5086-4781-9f7f-08b47865a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:45.058944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217c6d-84d5-4b60-973f-dd99b1a27244 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:45.103597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:45.104280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:45.104571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:45.104857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:45.105880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] RBAC: Adding query filter params (group.id=1115018ce281471081fc89daba3d1d33, role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=b549cbd5077d4178b499b2510c76f517) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:45.106202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:45.107805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:45.126311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 192/381] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:44 2022] GET /identity/v3/role_assignments?group.id=1115018ce281471081fc89daba3d1d33&scope.project.id=b549cbd5077d4178b499b2510c76f517&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:45.144786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 190/382] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:45.174225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:45.204324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:45.304270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d299d2e-d032-4983-bb11-4014f4aca778 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:45.342534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc9ef2-95a7-4abf-8710-beeea5f7b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:45.343364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9ef2-95a7-4abf-8710-beeea5f7b49f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:45.343654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9ef2-95a7-4abf-8710-beeea5f7b49f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:45.343935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9ef2-95a7-4abf-8710-beeea5f7b49f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:45.355739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc9ef2-95a7-4abf-8710-beeea5f7b49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-51cc9ef2-95a7-4abf-8710-beeea5f7b49f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:45.364654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:45.365782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:45.366811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 193/383] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:45.373953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d653668-5086-4781-9f7f-08b47865a01d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:45.533031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d653668-5086-4781-9f7f-08b47865a01d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:45.561474 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:45.584234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:45.584967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:45.585241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:45.585517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:45.586347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:45.586665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:45.588091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:45.603826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 191/384] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:45.610024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc9ef2-95a7-4abf-8710-beeea5f7b49f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:45.718110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:45.740902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc9ef2-95a7-4abf-8710-beeea5f7b49f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:45.780341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cec2c-8c57-4a29-82bb-4f1ec33d79df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:45.781489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cec2c-8c57-4a29-82bb-4f1ec33d79df None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:45.781964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cec2c-8c57-4a29-82bb-4f1ec33d79df None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:45.782400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cec2c-8c57-4a29-82bb-4f1ec33d79df None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:45.783846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cec2c-8c57-4a29-82bb-4f1ec33d79df None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:45.785462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cec2c-8c57-4a29-82bb-4f1ec33d79df None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:45.788255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 194/385] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:45 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:45.794697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:45.941087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d87c6-eefe-42f3-a884-d181a95a1b7e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:45.988543 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93138304-3a1c-47ac-b5aa-e974fdf2c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:45.990021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93138304-3a1c-47ac-b5aa-e974fdf2c685 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:45.990311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93138304-3a1c-47ac-b5aa-e974fdf2c685 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:45.990595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93138304-3a1c-47ac-b5aa-e974fdf2c685 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:45.994297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93138304-3a1c-47ac-b5aa-e974fdf2c685 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:45.995782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93138304-3a1c-47ac-b5aa-e974fdf2c685 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:45.997852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 192/386] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:45 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:46.003203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cec2c-8c57-4a29-82bb-4f1ec33d79df None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:46.108591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee10d-f597-4f65-98bd-53079a0c1768 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:46.109631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee10d-f597-4f65-98bd-53079a0c1768 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:46.110139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee10d-f597-4f65-98bd-53079a0c1768 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:46.112043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 193/387] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:45:46.118750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f5504-5ec6-4ae5-99d6-92360d54ea0e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:46.119363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f5504-5ec6-4ae5-99d6-92360d54ea0e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:46.119848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f5504-5ec6-4ae5-99d6-92360d54ea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:46.140562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-472f5504-5ec6-4ae5-99d6-92360d54ea0e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:46.144400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-472f5504-5ec6-4ae5-99d6-92360d54ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:46.190272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cec2c-8c57-4a29-82bb-4f1ec33d79df None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:46.233747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295efa9-0c6b-43d6-ba98-0e83fb4f76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:46.235442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295efa9-0c6b-43d6-ba98-0e83fb4f76e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:46.235930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295efa9-0c6b-43d6-ba98-0e83fb4f76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:46.236409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295efa9-0c6b-43d6-ba98-0e83fb4f76e6 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206/groups/636f35956e2e40ff9942d412cc4a2851/roles/025cadb68d6641098d3edb9e47910aaf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:46.239719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295efa9-0c6b-43d6-ba98-0e83fb4f76e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b569a1d3ddb44429977459c3b6277206, group_id=636f35956e2e40ff9942d412cc4a2851, role_id=025cadb68d6641098d3edb9e47910aaf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:46.241430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295efa9-0c6b-43d6-ba98-0e83fb4f76e6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:46.253503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:46.263546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 195/388] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 8 12:45:46 2022] PUT /identity/v3/projects/b569a1d3ddb44429977459c3b6277206/groups/636f35956e2e40ff9942d412cc4a2851/roles/025cadb68d6641098d3edb9e47910aaf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:45:46.296758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 194/389] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:46.339181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295efa9-0c6b-43d6-ba98-0e83fb4f76e6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:46.352851 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:46.490228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295efa9-0c6b-43d6-ba98-0e83fb4f76e6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:46.527546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c45b70-6031-4e26-8e1a-83c1fa6c83a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:46.528373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c45b70-6031-4e26-8e1a-83c1fa6c83a7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:46.528670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c45b70-6031-4e26-8e1a-83c1fa6c83a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:46.528958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c45b70-6031-4e26-8e1a-83c1fa6c83a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:46.543576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c45b70-6031-4e26-8e1a-83c1fa6c83a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c4c45b70-6031-4e26-8e1a-83c1fa6c83a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:46.551801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:46.552944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:46.554492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 196/390] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:46.558946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f5504-5ec6-4ae5-99d6-92360d54ea0e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:46.694556 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f5504-5ec6-4ae5-99d6-92360d54ea0e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:46.754840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:46.755933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:46.756230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:46.756519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:46.757301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:46.757640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:46.759071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:46.775594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 195/391] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:46.781977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c45b70-6031-4e26-8e1a-83c1fa6c83a7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:46.907521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:46.957413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c45b70-6031-4e26-8e1a-83c1fa6c83a7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:47.014320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7906e-1642-455e-97f9-f53ee49a86df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:47.015206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7906e-1642-455e-97f9-f53ee49a86df None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:47.015490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7906e-1642-455e-97f9-f53ee49a86df None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:47.015769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7906e-1642-455e-97f9-f53ee49a86df None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:47.017064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7906e-1642-455e-97f9-f53ee49a86df None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:47.018562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7906e-1642-455e-97f9-f53ee49a86df None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:47.021101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 197/392] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:46 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:47.026525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:47.085185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235768-57e2-4797-9773-35c6de4972cb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:47.085527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235768-57e2-4797-9773-35c6de4972cb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:47.085816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235768-57e2-4797-9773-35c6de4972cb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:47.087475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 198/393] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:47.094457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1149127-0ec6-4fe1-bbe5-e86d017cd363 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:47.094750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1149127-0ec6-4fe1-bbe5-e86d017cd363 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:47.095038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1149127-0ec6-4fe1-bbe5-e86d017cd363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:47.107073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:47.126627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e1149127-0ec6-4fe1-bbe5-e86d017cd363 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:47.127843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e1149127-0ec6-4fe1-bbe5-e86d017cd363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:47.207976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a76992-7126-44ea-9ba6-0e3e73e0e49b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:47.224775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 199/394] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:47.262490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1149127-0ec6-4fe1-bbe5-e86d017cd363 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:47.263765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310caa0a-741d-490a-9a89-2742260a5d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:47.264735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310caa0a-741d-490a-9a89-2742260a5d7d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:47.265022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310caa0a-741d-490a-9a89-2742260a5d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:47.265310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310caa0a-741d-490a-9a89-2742260a5d7d None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:47.266602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310caa0a-741d-490a-9a89-2742260a5d7d None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:47.268072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310caa0a-741d-490a-9a89-2742260a5d7d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:47.270217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 196/395] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:47 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:47.282596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310caa0a-741d-490a-9a89-2742260a5d7d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:47.406000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:47.442160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310caa0a-741d-490a-9a89-2742260a5d7d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:47.470027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:47.485191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e32d65-c85e-468f-98cb-6a5847d541a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:47.486169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32d65-c85e-468f-98cb-6a5847d541a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:47.486460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32d65-c85e-468f-98cb-6a5847d541a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:47.486743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32d65-c85e-468f-98cb-6a5847d541a8 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206/groups/636f35956e2e40ff9942d412cc4a2851/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:47.488810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e32d65-c85e-468f-98cb-6a5847d541a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b569a1d3ddb44429977459c3b6277206, group_id=636f35956e2e40ff9942d412cc4a2851, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:47.490907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e32d65-c85e-468f-98cb-6a5847d541a8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:47.513217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 197/396] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 8 12:45:47 2022] PUT /identity/v3/projects/b569a1d3ddb44429977459c3b6277206/groups/636f35956e2e40ff9942d412cc4a2851/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:47.550426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1149127-0ec6-4fe1-bbe5-e86d017cd363 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:47.627970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98848da-0f37-4263-9a1e-d1bc32aaee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:47.628816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98848da-0f37-4263-9a1e-d1bc32aaee38 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:47.629109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98848da-0f37-4263-9a1e-d1bc32aaee38 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:47.629396 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98848da-0f37-4263-9a1e-d1bc32aaee38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:47.647994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98848da-0f37-4263-9a1e-d1bc32aaee38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b98848da-0f37-4263-9a1e-d1bc32aaee38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:47.656253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:47.657171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:47.658041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 200/397] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:47.664461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e32d65-c85e-468f-98cb-6a5847d541a8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:47.813860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e32d65-c85e-468f-98cb-6a5847d541a8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:47.853709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd184da2-6271-48b1-8ee3-76ca9757b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:47.854408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd184da2-6271-48b1-8ee3-76ca9757b0ba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:47.854696 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd184da2-6271-48b1-8ee3-76ca9757b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:47.854976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd184da2-6271-48b1-8ee3-76ca9757b0ba None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:47.855748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd184da2-6271-48b1-8ee3-76ca9757b0ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:47.856062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd184da2-6271-48b1-8ee3-76ca9757b0ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:47.857455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd184da2-6271-48b1-8ee3-76ca9757b0ba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:47.868395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 198/398] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:47.874140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98848da-0f37-4263-9a1e-d1bc32aaee38 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:47.992501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12057b0c-10ad-421a-beb1-5c35fe9d5bff None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:47.993079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12057b0c-10ad-421a-beb1-5c35fe9d5bff None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:47.993534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12057b0c-10ad-421a-beb1-5c35fe9d5bff None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:47.995155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 199/399] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:48.003437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ed61-6d31-4ab7-85b5-7b56d7cded63 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:48.004006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ed61-6d31-4ab7-85b5-7b56d7cded63 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:48.004985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ed61-6d31-4ab7-85b5-7b56d7cded63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:48.006324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98848da-0f37-4263-9a1e-d1bc32aaee38 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:48.038063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:48.046020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c885ed61-6d31-4ab7-85b5-7b56d7cded63 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:48.046360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a2f13-56f4-44d2-9fe0-d9db81579ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:48.047328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2f13-56f4-44d2-9fe0-d9db81579ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:48.047619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2f13-56f4-44d2-9fe0-d9db81579ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:48.047898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2f13-56f4-44d2-9fe0-d9db81579ec3 None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:48.048583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c885ed61-6d31-4ab7-85b5-7b56d7cded63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:48.049152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a2f13-56f4-44d2-9fe0-d9db81579ec3 None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:48.050677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a2f13-56f4-44d2-9fe0-d9db81579ec3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:48.054310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 201/400] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:47 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:48.060542 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a2f13-56f4-44d2-9fe0-d9db81579ec3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:48.119716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:48.251807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 200/401] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:48.264359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a2f13-56f4-44d2-9fe0-d9db81579ec3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:48.289429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ed61-6d31-4ab7-85b5-7b56d7cded63 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:48.374243 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ef4ec-92cc-4568-b72a-3f12ed40bb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:48.375746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ef4ec-92cc-4568-b72a-3f12ed40bb3b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:48.376252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ef4ec-92cc-4568-b72a-3f12ed40bb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:48.376764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ef4ec-92cc-4568-b72a-3f12ed40bb3b None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:48.382839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ef4ec-92cc-4568-b72a-3f12ed40bb3b None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:48.384382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ef4ec-92cc-4568-b72a-3f12ed40bb3b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:48.386307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 202/402] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:48 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:48.401149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ef4ec-92cc-4568-b72a-3f12ed40bb3b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:48.485743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:48.555942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ed61-6d31-4ab7-85b5-7b56d7cded63 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:48.561554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ef4ec-92cc-4568-b72a-3f12ed40bb3b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:48.632179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f4087-036b-4cbd-abb3-3f91ea67b282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:48.632928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4087-036b-4cbd-abb3-3f91ea67b282 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:48.633219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4087-036b-4cbd-abb3-3f91ea67b282 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:48.634171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4087-036b-4cbd-abb3-3f91ea67b282 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:48.635322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828a94-3fd8-4228-a70d-bf8311b7b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:48.636223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828a94-3fd8-4228-a70d-bf8311b7b313 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:48.636510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828a94-3fd8-4228-a70d-bf8311b7b313 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:48.636794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828a94-3fd8-4228-a70d-bf8311b7b313 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/groups/636f35956e2e40ff9942d412cc4a2851/roles/025cadb68d6641098d3edb9e47910aaf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:48.641295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828a94-3fd8-4228-a70d-bf8311b7b313 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf204ba855ce4d5db5fc90ea1cde42f9, group_id=636f35956e2e40ff9942d412cc4a2851, role_id=025cadb68d6641098d3edb9e47910aaf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:48.642825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828a94-3fd8-4228-a70d-bf8311b7b313 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:48.663059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f4087-036b-4cbd-abb3-3f91ea67b282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-081f4087-036b-4cbd-abb3-3f91ea67b282 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:48.670985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:48.671959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:48.672746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:48.680156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 203/404] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 8 12:45:48 2022] PUT /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/groups/636f35956e2e40ff9942d412cc4a2851/roles/025cadb68d6641098d3edb9e47910aaf => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:48.680332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 201/404] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:48.681981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828a94-3fd8-4228-a70d-bf8311b7b313 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:48.734891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0841d9-2c6a-40ff-a625-32684d1f036c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:48.735202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0841d9-2c6a-40ff-a625-32684d1f036c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:48.735663 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0841d9-2c6a-40ff-a625-32684d1f036c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:48.737468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 202/405] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:48.751442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f9553-b84e-4e01-8784-4e666fdb57d6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:48.751746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f9553-b84e-4e01-8784-4e666fdb57d6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:48.752009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f9553-b84e-4e01-8784-4e666fdb57d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:48.781851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f07f9553-b84e-4e01-8784-4e666fdb57d6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:48.783132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f07f9553-b84e-4e01-8784-4e666fdb57d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:48.821793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828a94-3fd8-4228-a70d-bf8311b7b313 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:48.824541 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:48.864899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:48.896303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:48.896914 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:48.897209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:48.897499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:48.898321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:48.898640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:48.900095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:48.915597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 204/406] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:48.916927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:48.983759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 203/407] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:49.018856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f9553-b84e-4e01-8784-4e666fdb57d6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:49.043416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994b1b-02e8-450b-bea3-9b8f425ed84a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:49.094951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9767605-e8f0-40c2-b892-a64af3ee2566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:49.096450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767605-e8f0-40c2-b892-a64af3ee2566 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:49.096961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767605-e8f0-40c2-b892-a64af3ee2566 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:49.097476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767605-e8f0-40c2-b892-a64af3ee2566 None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:49.099860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9767605-e8f0-40c2-b892-a64af3ee2566 None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:49.102714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9767605-e8f0-40c2-b892-a64af3ee2566 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:49.113267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 205/408] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:48 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:49.115952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9767605-e8f0-40c2-b892-a64af3ee2566 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:49.216196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:49.294521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9767605-e8f0-40c2-b892-a64af3ee2566 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:49.337411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0958cd3-fec1-49c8-bb52-573d980b56a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:49.338350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958cd3-fec1-49c8-bb52-573d980b56a9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:49.338740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958cd3-fec1-49c8-bb52-573d980b56a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:49.339039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958cd3-fec1-49c8-bb52-573d980b56a9 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:49.340349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0958cd3-fec1-49c8-bb52-573d980b56a9 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:49.341879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0958cd3-fec1-49c8-bb52-573d980b56a9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:49.347607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f9553-b84e-4e01-8784-4e666fdb57d6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:49.349004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 206/409] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:49 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:49.350451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0958cd3-fec1-49c8-bb52-573d980b56a9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:49.402453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac771a8-ff37-4c83-9515-4c16a003ba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:49.403344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac771a8-ff37-4c83-9515-4c16a003ba65 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:49.403639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac771a8-ff37-4c83-9515-4c16a003ba65 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:49.403919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac771a8-ff37-4c83-9515-4c16a003ba65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:49.427291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac771a8-ff37-4c83-9515-4c16a003ba65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2ac771a8-ff37-4c83-9515-4c16a003ba65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:49.445422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:49.446458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:49.447263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:49.450688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 204/410] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:49.454195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac771a8-ff37-4c83-9515-4c16a003ba65 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:49.482564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:49.518691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0958cd3-fec1-49c8-bb52-573d980b56a9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:49.564768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:49.591624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fa98f-000f-41df-afe2-a64e13cf8fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:49.592962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa98f-000f-41df-afe2-a64e13cf8fb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:49.593249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa98f-000f-41df-afe2-a64e13cf8fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:49.593569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa98f-000f-41df-afe2-a64e13cf8fb8 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/groups/636f35956e2e40ff9942d412cc4a2851/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:49.596400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fa98f-000f-41df-afe2-a64e13cf8fb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf204ba855ce4d5db5fc90ea1cde42f9, group_id=636f35956e2e40ff9942d412cc4a2851, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:49.599002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fa98f-000f-41df-afe2-a64e13cf8fb8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:49.600440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac771a8-ff37-4c83-9515-4c16a003ba65 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:49.630176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 207/411] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 8 12:45:49 2022] PUT /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9/groups/636f35956e2e40ff9942d412cc4a2851/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:49.634351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11dce4-9f61-488f-b255-daf2c984b645 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:49.636514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11dce4-9f61-488f-b255-daf2c984b645 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:49.637047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11dce4-9f61-488f-b255-daf2c984b645 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:49.640511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 208/412] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:49.648328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36425-faad-49bb-a038-acf2f4c7c1ad None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:49.648665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36425-faad-49bb-a038-acf2f4c7c1ad None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:49.649939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36425-faad-49bb-a038-acf2f4c7c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:49.669208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:49.670131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:49.670429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:49.670767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:49.671547 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:49.671936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:49.673448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:49.686751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0ac36425-faad-49bb-a038-acf2f4c7c1ad None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:49.687971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ac36425-faad-49bb-a038-acf2f4c7c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:49.689929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 205/413] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:49.695807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:49.830689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:49.859545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 209/414] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:49.875262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d89681-9737-43c9-bff4-e2bebb11c8ad None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:49.897816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36425-faad-49bb-a038-acf2f4c7c1ad None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:49.921710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae745-e83a-4bef-82ca-5f52b7d74c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:49.922957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae745-e83a-4bef-82ca-5f52b7d74c8e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:49.923438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae745-e83a-4bef-82ca-5f52b7d74c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:49.923964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae745-e83a-4bef-82ca-5f52b7d74c8e None admin] PATH_INFO: `/v3/groups/1115018ce281471081fc89daba3d1d33` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:49.925537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ae745-e83a-4bef-82ca-5f52b7d74c8e None admin] RBAC: Authorizing `identity:get_group(group_id=1115018ce281471081fc89daba3d1d33)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:49.928578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ae745-e83a-4bef-82ca-5f52b7d74c8e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:49.930914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 206/415] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:49 2022] GET /identity/v3/groups/1115018ce281471081fc89daba3d1d33 => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:49.939630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae745-e83a-4bef-82ca-5f52b7d74c8e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:50.039997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36425-faad-49bb-a038-acf2f4c7c1ad None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:50.054592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:50.085417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837525a2-57c1-4dec-aad7-988e2d82ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:50.087207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837525a2-57c1-4dec-aad7-988e2d82ac24 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.087773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837525a2-57c1-4dec-aad7-988e2d82ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:50.088254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837525a2-57c1-4dec-aad7-988e2d82ac24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:50.103645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837525a2-57c1-4dec-aad7-988e2d82ac24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-837525a2-57c1-4dec-aad7-988e2d82ac24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:50.118304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:50.119253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:50.120039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:50.123283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 210/416] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:50.131581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837525a2-57c1-4dec-aad7-988e2d82ac24 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:50.147045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae745-e83a-4bef-82ca-5f52b7d74c8e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:50.214869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450a9f5-e13d-4342-b242-446532f66bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:50.215794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450a9f5-e13d-4342-b242-446532f66bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.216085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450a9f5-e13d-4342-b242-446532f66bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:50.216373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450a9f5-e13d-4342-b242-446532f66bf3 None admin] PATH_INFO: `/v3/projects/b549cbd5077d4178b499b2510c76f517` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:50.217709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450a9f5-e13d-4342-b242-446532f66bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=b549cbd5077d4178b499b2510c76f517)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:50.219197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450a9f5-e13d-4342-b242-446532f66bf3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:50.221154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 207/417] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:49 2022] GET /identity/v3/projects/b549cbd5077d4178b499b2510c76f517 => generated 344 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:50.229725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450a9f5-e13d-4342-b242-446532f66bf3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:50.252888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:50.318739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837525a2-57c1-4dec-aad7-988e2d82ac24 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:50.365695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:50.366993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.367471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:50.367938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:50.368938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:50.369490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:50.371463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:50.383598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 211/418] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:50.389024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:50.432791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450a9f5-e13d-4342-b242-446532f66bf3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:50.440108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:50.522983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfb606-c374-41b0-99ca-f62bca1f4fac None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:50.555197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd191cd-bcaf-4ae2-adff-1f6ae2b99e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:50.556443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd191cd-bcaf-4ae2-adff-1f6ae2b99e31 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.556885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd191cd-bcaf-4ae2-adff-1f6ae2b99e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:50.557316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd191cd-bcaf-4ae2-adff-1f6ae2b99e31 None admin] PATH_INFO: `/v3/projects/b549cbd5077d4178b499b2510c76f517/groups/1115018ce281471081fc89daba3d1d33/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:50.559540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd191cd-bcaf-4ae2-adff-1f6ae2b99e31 None admin] RBAC: Authorizing `identity:create_grant(project_id=b549cbd5077d4178b499b2510c76f517, group_id=1115018ce281471081fc89daba3d1d33, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:50.561145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd191cd-bcaf-4ae2-adff-1f6ae2b99e31 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:50.562490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82480bb-6d71-4e1d-bf17-51054d06ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:50.563152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82480bb-6d71-4e1d-bf17-51054d06ded4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.563446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82480bb-6d71-4e1d-bf17-51054d06ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:50.563733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82480bb-6d71-4e1d-bf17-51054d06ded4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:50.578600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 208/419] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 8 12:45:50 2022] PUT /identity/v3/projects/b549cbd5077d4178b499b2510c76f517/groups/1115018ce281471081fc89daba3d1d33/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:45:50.580299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec2fb2-fd63-47d2-9a43-6722730b88d0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.580834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec2fb2-fd63-47d2-9a43-6722730b88d0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:50.581401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec2fb2-fd63-47d2-9a43-6722730b88d0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:50.583624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 209/420] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:50.589891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82e34-90da-4514-8a48-143712fa2016 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.590454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82e34-90da-4514-8a48-143712fa2016 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:50.590960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82e34-90da-4514-8a48-143712fa2016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:50.611954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ebc82e34-90da-4514-8a48-143712fa2016 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:50.613634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ebc82e34-90da-4514-8a48-143712fa2016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:50.646266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82480bb-6d71-4e1d-bf17-51054d06ded4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:50.648028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82480bb-6d71-4e1d-bf17-51054d06ded4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:50.683705 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:50.695716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:50.703294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 210/421] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:50.732046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82e34-90da-4514-8a48-143712fa2016 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:50.778335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 212/422] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:50.786834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82480bb-6d71-4e1d-bf17-51054d06ded4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:50.852513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82e34-90da-4514-8a48-143712fa2016 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:50.895981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558304f4-bf82-4944-83a7-806438ec6c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:50.897678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558304f4-bf82-4944-83a7-806438ec6c9f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.898260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558304f4-bf82-4944-83a7-806438ec6c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:50.898743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558304f4-bf82-4944-83a7-806438ec6c9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:50.912526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558304f4-bf82-4944-83a7-806438ec6c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-558304f4-bf82-4944-83a7-806438ec6c9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:50.921083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:50.922098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:50.922905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:50.929252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 211/423] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:50.930437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558304f4-bf82-4944-83a7-806438ec6c9f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:50.950271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82480bb-6d71-4e1d-bf17-51054d06ded4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:50.985197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:50.997526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83377-a8f4-43dc-89ef-203da542a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:50.999080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83377-a8f4-43dc-89ef-203da542a940 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:50.999879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83377-a8f4-43dc-89ef-203da542a940 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.000759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:51.001326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83377-a8f4-43dc-89ef-203da542a940 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.004789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f83377-a8f4-43dc-89ef-203da542a940 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:51.006937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f83377-a8f4-43dc-89ef-203da542a940 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:51.009344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 213/424] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:50 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:51.018427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83377-a8f4-43dc-89ef-203da542a940 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:51.056549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558304f4-bf82-4944-83a7-806438ec6c9f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:51.096089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:51.096782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:51.097176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.097366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.098721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:51.099053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:51.100469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:51.110191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 212/425] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:51.118720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:51.137483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83377-a8f4-43dc-89ef-203da542a940 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:51.176908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74419867-c7b8-4d22-9377-eae573f72b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:51.178174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419867-c7b8-4d22-9377-eae573f72b26 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:51.178702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419867-c7b8-4d22-9377-eae573f72b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.179180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419867-c7b8-4d22-9377-eae573f72b26 None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.180796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74419867-c7b8-4d22-9377-eae573f72b26 None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:51.182538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74419867-c7b8-4d22-9377-eae573f72b26 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:51.184968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 214/426] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:51 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:51.190920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74419867-c7b8-4d22-9377-eae573f72b26 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:51.240401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f847e2-c04f-4567-8e0c-6736624ed272 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:51.268950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:51.283971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39603dba-0c2f-4506-80d9-23098ba1150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:51.284644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39603dba-0c2f-4506-80d9-23098ba1150b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:51.284945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39603dba-0c2f-4506-80d9-23098ba1150b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.285285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39603dba-0c2f-4506-80d9-23098ba1150b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.292827 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:51.337351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74419867-c7b8-4d22-9377-eae573f72b26 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:51.388767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54cc0-da94-4895-8b91-006e30b461d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:51.395877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54cc0-da94-4895-8b91-006e30b461d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:51.396534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54cc0-da94-4895-8b91-006e30b461d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.397041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54cc0-da94-4895-8b91-006e30b461d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.398168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54cc0-da94-4895-8b91-006e30b461d0 None admin] RBAC: Adding query filter params (group.id=636f35956e2e40ff9942d412cc4a2851, role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=b569a1d3ddb44429977459c3b6277206) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:51.398690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54cc0-da94-4895-8b91-006e30b461d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:51.400373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54cc0-da94-4895-8b91-006e30b461d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:51.418782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 215/427] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:51 2022] GET /identity/v3/role_assignments?group.id=636f35956e2e40ff9942d412cc4a2851&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=025cadb68d6641098d3edb9e47910aaf => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:51.486183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39603dba-0c2f-4506-80d9-23098ba1150b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:51.487640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39603dba-0c2f-4506-80d9-23098ba1150b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:51.618925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546c403-813d-48cb-ba03-eb33a22d8307 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:51.619259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546c403-813d-48cb-ba03-eb33a22d8307 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.619497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546c403-813d-48cb-ba03-eb33a22d8307 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.621176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 216/428] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:45:51.628524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5c43-e0ce-48c9-aadf-c827e8cea837 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:51.628835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5c43-e0ce-48c9-aadf-c827e8cea837 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.629082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5c43-e0ce-48c9-aadf-c827e8cea837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.637379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 213/429] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 12:45:51.643018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39603dba-0c2f-4506-80d9-23098ba1150b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:51.665490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-56ba5c43-e0ce-48c9-aadf-c827e8cea837 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:51.666801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-56ba5c43-e0ce-48c9-aadf-c827e8cea837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:51.673981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:51.756349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39603dba-0c2f-4506-80d9-23098ba1150b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:51.763978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 217/430] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:51.791299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba5c43-e0ce-48c9-aadf-c827e8cea837 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:51.810324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb192-43e5-4c93-85c9-a2a9d37dab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:51.811555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb192-43e5-4c93-85c9-a2a9d37dab04 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:51.812046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb192-43e5-4c93-85c9-a2a9d37dab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.812548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb192-43e5-4c93-85c9-a2a9d37dab04 None admin] PATH_INFO: `/v3/projects/b569a1d3ddb44429977459c3b6277206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.814119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb192-43e5-4c93-85c9-a2a9d37dab04 None admin] RBAC: Authorizing `identity:get_project(project_id=b569a1d3ddb44429977459c3b6277206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:51.816146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb192-43e5-4c93-85c9-a2a9d37dab04 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:51.823474 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 214/431] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:51 2022] GET /identity/v3/projects/b569a1d3ddb44429977459c3b6277206 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:51.825187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb192-43e5-4c93-85c9-a2a9d37dab04 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:51.868056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:51.910395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba5c43-e0ce-48c9-aadf-c827e8cea837 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:51.948698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:51.953867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43828c2-84fb-4241-b1b9-e58c8aebc60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:51.955349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43828c2-84fb-4241-b1b9-e58c8aebc60b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:51.955778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43828c2-84fb-4241-b1b9-e58c8aebc60b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:51.956157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43828c2-84fb-4241-b1b9-e58c8aebc60b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:51.962971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb192-43e5-4c93-85c9-a2a9d37dab04 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:51.972260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43828c2-84fb-4241-b1b9-e58c8aebc60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b43828c2-84fb-4241-b1b9-e58c8aebc60b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:51.984228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:51.985199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:45:51.986353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:51.989638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 218/432] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:45:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:51.993823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43828c2-84fb-4241-b1b9-e58c8aebc60b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:52.013073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440d30-0a46-448b-8c1c-99dff2a50491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:52.013982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440d30-0a46-448b-8c1c-99dff2a50491 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.014339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440d30-0a46-448b-8c1c-99dff2a50491 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.014689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440d30-0a46-448b-8c1c-99dff2a50491 None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.015966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc440d30-0a46-448b-8c1c-99dff2a50491 None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:52.017527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc440d30-0a46-448b-8c1c-99dff2a50491 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:52.024740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 215/433] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:51 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:52.027007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440d30-0a46-448b-8c1c-99dff2a50491 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:52.149249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43828c2-84fb-4241-b1b9-e58c8aebc60b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:52.169077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440d30-0a46-448b-8c1c-99dff2a50491 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:52.180982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:52.198366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:52.199931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.200586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.201184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.202499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:52.203346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:52.205575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:52.208964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:52.210091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.210091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.210428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.211372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] RBAC: Adding query filter params (group.id=636f35956e2e40ff9942d412cc4a2851, role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=b569a1d3ddb44429977459c3b6277206) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:52.211758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:52.213291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:52.219382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 219/434] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:45:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:52.225959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:52.226147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 216/435] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:52 2022] GET /identity/v3/role_assignments?group.id=636f35956e2e40ff9942d412cc4a2851&scope.project.id=b569a1d3ddb44429977459c3b6277206&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:52.352902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8bba4-d18e-4016-8fd9-6c2bc0e21065 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:52.392949 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9070-bb96-42b9-afbc-c738f57b6d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:52.393659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9070-bb96-42b9-afbc-c738f57b6d7e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.393954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9070-bb96-42b9-afbc-c738f57b6d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.394304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9070-bb96-42b9-afbc-c738f57b6d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.456296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:52.472791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a9070-bb96-42b9-afbc-c738f57b6d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:52.474937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a9070-bb96-42b9-afbc-c738f57b6d7e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:52.594672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 220/436] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:52.600932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:52.618541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0f97-3930-43ea-80f3-9ee8cbddd8cb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.619038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0f97-3930-43ea-80f3-9ee8cbddd8cb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.619460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0f97-3930-43ea-80f3-9ee8cbddd8cb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.620997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 221/437] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:52.626741 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a513ef-6446-4779-a6e9-22fd004aa8d8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.627052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a513ef-6446-4779-a6e9-22fd004aa8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.627334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a513ef-6446-4779-a6e9-22fd004aa8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.630998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:52.649331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f4a513ef-6446-4779-a6e9-22fd004aa8d8 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:52.650631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f4a513ef-6446-4779-a6e9-22fd004aa8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:52.744137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0a1b4-6278-4a28-9eee-acf92293c50e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:52.751998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 222/438] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:52.777180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a513ef-6446-4779-a6e9-22fd004aa8d8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:52.784928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef80e-ddd3-41fd-87ca-76fc846c094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:52.785990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef80e-ddd3-41fd-87ca-76fc846c094b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.786949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef80e-ddd3-41fd-87ca-76fc846c094b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.787235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef80e-ddd3-41fd-87ca-76fc846c094b None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.788536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edef80e-ddd3-41fd-87ca-76fc846c094b None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:52.790968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edef80e-ddd3-41fd-87ca-76fc846c094b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:52.792781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 217/439] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:52 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:52.798330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef80e-ddd3-41fd-87ca-76fc846c094b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:52.798833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:52.929350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a513ef-6446-4779-a6e9-22fd004aa8d8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:52.935244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:52.941277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef80e-ddd3-41fd-87ca-76fc846c094b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:52.977283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c70c8-29fd-4900-a034-d20bc2033945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:52.978275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c70c8-29fd-4900-a034-d20bc2033945 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.978563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c70c8-29fd-4900-a034-d20bc2033945 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.978837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c70c8-29fd-4900-a034-d20bc2033945 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.984718 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a0fe9-69e1-486b-8436-b4fe3b17c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:52.985673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0fe9-69e1-486b-8436-b4fe3b17c668 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:52.985966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0fe9-69e1-486b-8436-b4fe3b17c668 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:52.986251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0fe9-69e1-486b-8436-b4fe3b17c668 None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:52.987510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a0fe9-69e1-486b-8436-b4fe3b17c668 None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:52.989954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a0fe9-69e1-486b-8436-b4fe3b17c668 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:52.992384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 218/440] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:52 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:52.998261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c70c8-29fd-4900-a034-d20bc2033945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:52.999286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a0fe9-69e1-486b-8436-b4fe3b17c668 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-dd9c70c8-29fd-4900-a034-d20bc2033945 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:53.007143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:53.008287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 12:45:53.009259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:53.011794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 223/441] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:53.020515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c70c8-29fd-4900-a034-d20bc2033945 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:53.118337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:53.118974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a0fe9-69e1-486b-8436-b4fe3b17c668 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:53.148612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c70c8-29fd-4900-a034-d20bc2033945 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:53.156903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:53.157935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:53.158405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:53.158856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:53.159993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] RBAC: Adding query filter params (group.id=636f35956e2e40ff9942d412cc4a2851, role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:53.161060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:53.163033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:53.170996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 219/442] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:52 2022] GET /identity/v3/role_assignments?group.id=636f35956e2e40ff9942d412cc4a2851&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=025cadb68d6641098d3edb9e47910aaf => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:53.201834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2ea3-8fc0-4526-88ef-633fe460a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:53.202573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2ea3-8fc0-4526-88ef-633fe460a9af None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:53.202933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2ea3-8fc0-4526-88ef-633fe460a9af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:53.203283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2ea3-8fc0-4526-88ef-633fe460a9af None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:53.204192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2ea3-8fc0-4526-88ef-633fe460a9af None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:53.204576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2ea3-8fc0-4526-88ef-633fe460a9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:53.206231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2ea3-8fc0-4526-88ef-633fe460a9af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:53.217084 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 224/443] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:45:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:53.222623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:53.253435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:53.343426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8725-3e02-4084-acb5-9f7720f93fc7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:53.385813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2b05-d750-4144-ad47-1cee8570e1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:53.386502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2b05-d750-4144-ad47-1cee8570e1bb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:53.386799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2b05-d750-4144-ad47-1cee8570e1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:53.387078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2b05-d750-4144-ad47-1cee8570e1bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:53.485971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2b05-d750-4144-ad47-1cee8570e1bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:53.487374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2b05-d750-4144-ad47-1cee8570e1bb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:53.513350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:53.536866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf77d5-ddde-4df3-aaeb-068b9e031530 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:53.537494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf77d5-ddde-4df3-aaeb-068b9e031530 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:53.538054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf77d5-ddde-4df3-aaeb-068b9e031530 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:53.539847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 225/444] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:53.545237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815ec4-1a0d-40f2-9ce7-56278f942b1c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:53.545534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815ec4-1a0d-40f2-9ce7-56278f942b1c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:53.545846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815ec4-1a0d-40f2-9ce7-56278f942b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:53.562803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2f815ec4-1a0d-40f2-9ce7-56278f942b1c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:53.564082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2f815ec4-1a0d-40f2-9ce7-56278f942b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:53.596219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 220/445] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:45:53.602811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2b05-d750-4144-ad47-1cee8570e1bb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:53.642677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 226/446] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:53.667336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f815ec4-1a0d-40f2-9ce7-56278f942b1c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:53.709366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2b05-d750-4144-ad47-1cee8570e1bb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:53.734495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:53.745819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:53.747437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38067d6b-146e-4f88-b11d-d31e8fff44d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:53.748318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067d6b-146e-4f88-b11d-d31e8fff44d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:53.748603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067d6b-146e-4f88-b11d-d31e8fff44d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:53.748883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067d6b-146e-4f88-b11d-d31e8fff44d2 None admin] PATH_INFO: `/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:53.750124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38067d6b-146e-4f88-b11d-d31e8fff44d2 None admin] RBAC: Authorizing `identity:get_project(project_id=cf204ba855ce4d5db5fc90ea1cde42f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:53.751574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38067d6b-146e-4f88-b11d-d31e8fff44d2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:53.753285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 221/447] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:53 2022] GET /identity/v3/projects/cf204ba855ce4d5db5fc90ea1cde42f9 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:53.759526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38067d6b-146e-4f88-b11d-d31e8fff44d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:53.782440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f815ec4-1a0d-40f2-9ce7-56278f942b1c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:53.827028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56ae8f-dcad-49a5-94aa-9067b036c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:53.827830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56ae8f-dcad-49a5-94aa-9067b036c31c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:53.828114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56ae8f-dcad-49a5-94aa-9067b036c31c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:53.828387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56ae8f-dcad-49a5-94aa-9067b036c31c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:53.839419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56ae8f-dcad-49a5-94aa-9067b036c31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6c56ae8f-dcad-49a5-94aa-9067b036c31c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:45:53.847116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:53.848664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:53.849460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 227/448] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:53.855029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56ae8f-dcad-49a5-94aa-9067b036c31c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:53.881573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38067d6b-146e-4f88-b11d-d31e8fff44d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:53.917624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee24d21-90a4-45c5-9298-6fcb54bc1bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:53.918511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24d21-90a4-45c5-9298-6fcb54bc1bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:53.918795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24d21-90a4-45c5-9298-6fcb54bc1bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:53.919074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24d21-90a4-45c5-9298-6fcb54bc1bb4 None admin] PATH_INFO: `/v3/groups/636f35956e2e40ff9942d412cc4a2851` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:53.920384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee24d21-90a4-45c5-9298-6fcb54bc1bb4 None admin] RBAC: Authorizing `identity:get_group(group_id=636f35956e2e40ff9942d412cc4a2851)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:53.921901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee24d21-90a4-45c5-9298-6fcb54bc1bb4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:53.923654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 222/449] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:53 2022] GET /identity/v3/groups/636f35956e2e40ff9942d412cc4a2851 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:53.930221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee24d21-90a4-45c5-9298-6fcb54bc1bb4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:53.971932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56ae8f-dcad-49a5-94aa-9067b036c31c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:53.992069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:54.001401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:54.012812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:54.013993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:54.014495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:54.014968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:54.016367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:54.016810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:54.018397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:54.027921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 228/450] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:54.033567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:54.048403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee24d21-90a4-45c5-9298-6fcb54bc1bb4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:54.085038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:54.085755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:54.086106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:54.086393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:54.087240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] RBAC: Adding query filter params (group.id=636f35956e2e40ff9942d412cc4a2851, role.id=a73bec0a8208424e89eba3acdec2e49a, scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:54.087557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:54.089116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:54.095177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 223/451] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:53 2022] GET /identity/v3/role_assignments?group.id=636f35956e2e40ff9942d412cc4a2851&scope.project.id=cf204ba855ce4d5db5fc90ea1cde42f9&role.id=a73bec0a8208424e89eba3acdec2e49a => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:54.148824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354582-853d-46d1-877e-189616869ea0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:54.186408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de96bd4-6332-438d-9d97-c7b62c8fb341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:54.187074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de96bd4-6332-438d-9d97-c7b62c8fb341 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:54.187365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de96bd4-6332-438d-9d97-c7b62c8fb341 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:54.187650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de96bd4-6332-438d-9d97-c7b62c8fb341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:54.261135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:54.275964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de96bd4-6332-438d-9d97-c7b62c8fb341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:54.277500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de96bd4-6332-438d-9d97-c7b62c8fb341 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:54.386530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 229/452] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:45:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 12:45:54.393753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:54.508772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafad6ed-2826-4d61-b211-c0467ff995e7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:54.533459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:54.546094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b37ba-3f0b-4b5f-ab9b-020f54a95c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:54.547719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b37ba-3f0b-4b5f-ab9b-020f54a95c42 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:54.547719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b37ba-3f0b-4b5f-ab9b-020f54a95c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:54.547719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b37ba-3f0b-4b5f-ab9b-020f54a95c42 None admin] PATH_INFO: `/v3/projects/b549cbd5077d4178b499b2510c76f517` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:54.548831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b37ba-3f0b-4b5f-ab9b-020f54a95c42 None admin] RBAC: Authorizing `identity:get_project(project_id=b549cbd5077d4178b499b2510c76f517)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:54.550502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b37ba-3f0b-4b5f-ab9b-020f54a95c42 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:54.552355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 224/453] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:45:54 2022] GET /identity/v3/projects/b549cbd5077d4178b499b2510c76f517 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:45:54.558168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de96bd4-6332-438d-9d97-c7b62c8fb341 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:54.663439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:54.681246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de96bd4-6332-438d-9d97-c7b62c8fb341 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:54.716275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095862c-b88e-4c07-bf29-44dfbf76b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:54.717133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095862c-b88e-4c07-bf29-44dfbf76b579 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:54.717417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095862c-b88e-4c07-bf29-44dfbf76b579 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:54.717725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095862c-b88e-4c07-bf29-44dfbf76b579 None admin] PATH_INFO: `/v3/groups/1115018ce281471081fc89daba3d1d33` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:54.718917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095862c-b88e-4c07-bf29-44dfbf76b579 None admin] RBAC: Authorizing `identity:get_group(group_id=1115018ce281471081fc89daba3d1d33)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:54.720378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095862c-b88e-4c07-bf29-44dfbf76b579 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:54.722065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 230/454] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 8 12:45:54 2022] GET /identity/v3/groups/1115018ce281471081fc89daba3d1d33 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:54.728309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b37ba-3f0b-4b5f-ab9b-020f54a95c42 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:54.835084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b37ba-3f0b-4b5f-ab9b-020f54a95c42 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:54.868939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3354168-b657-460d-926b-e3a609781d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:54.869623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354168-b657-460d-926b-e3a609781d36 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:54.869908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354168-b657-460d-926b-e3a609781d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:54.870184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354168-b657-460d-926b-e3a609781d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:54.871023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3354168-b657-460d-926b-e3a609781d36 None admin] RBAC: Adding query filter params (group.id=1115018ce281471081fc89daba3d1d33, role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=b549cbd5077d4178b499b2510c76f517) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:54.871337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3354168-b657-460d-926b-e3a609781d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:54.872770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3354168-b657-460d-926b-e3a609781d36 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:54.878617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 225/455] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 8 12:45:54 2022] GET /identity/v3/role_assignments?group.id=1115018ce281471081fc89daba3d1d33&scope.project.id=b549cbd5077d4178b499b2510c76f517&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:58.258993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ea2c-ead4-4440-b8d9-92a76ef97c12 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.260032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ea2c-ead4-4440-b8d9-92a76ef97c12 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.260539 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ea2c-ead4-4440-b8d9-92a76ef97c12 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.262522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 231/456] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:58.267442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcfbd5-cf9c-4973-900a-2e36ad87aa29 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.268239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcfbd5-cf9c-4973-900a-2e36ad87aa29 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.268739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcfbd5-cf9c-4973-900a-2e36ad87aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.299659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cbfcfbd5-cf9c-4973-900a-2e36ad87aa29 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:58.301250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cbfcfbd5-cf9c-4973-900a-2e36ad87aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:58.321983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585b3e7-37d2-451c-a2dd-e8f07f000be0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.322617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585b3e7-37d2-451c-a2dd-e8f07f000be0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.323141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585b3e7-37d2-451c-a2dd-e8f07f000be0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.324873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 232/457] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:58.337276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa5a5-b2af-4830-a1e3-519008228efc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.337823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa5a5-b2af-4830-a1e3-519008228efc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.338293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa5a5-b2af-4830-a1e3-519008228efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.377701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e00aa5a5-b2af-4830-a1e3-519008228efc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:58.380124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e00aa5a5-b2af-4830-a1e3-519008228efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:58.432182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:58.452560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 226/458] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:58.459481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134f5c9-7b95-49d0-8456-59adf75a1ddc None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.460143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134f5c9-7b95-49d0-8456-59adf75a1ddc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.460608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134f5c9-7b95-49d0-8456-59adf75a1ddc None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.463076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 227/459] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:58.468943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fef8-1efc-4963-95f5-9a7c709d147d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.469668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fef8-1efc-4963-95f5-9a7c709d147d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.470356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fef8-1efc-4963-95f5-9a7c709d147d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.477672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 233/460] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:58.497451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ec64fef8-1efc-4963-95f5-9a7c709d147d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:58.499670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa5a5-b2af-4830-a1e3-519008228efc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:58.500067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ec64fef8-1efc-4963-95f5-9a7c709d147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:58.604030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:58.613111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 228/461] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:45:58.615100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64fef8-1efc-4963-95f5-9a7c709d147d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:58.623607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa5a5-b2af-4830-a1e3-519008228efc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:58.674011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28869be9-d482-4421-8ff4-62631644c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:58.675064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28869be9-d482-4421-8ff4-62631644c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.675354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28869be9-d482-4421-8ff4-62631644c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.675628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28869be9-d482-4421-8ff4-62631644c8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.690950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28869be9-d482-4421-8ff4-62631644c8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:58.692878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28869be9-d482-4421-8ff4-62631644c8e7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-28869be9-d482-4421-8ff4-62631644c8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:45:58.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:58.714739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:58.716138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:45:58.716138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:45:58.716138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:45:58.716138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:58.716138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 234/462] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:45:58.716138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5592f-914a-4050-922b-c6d28d13bb73 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.717821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5592f-914a-4050-922b-c6d28d13bb73 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.717821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5592f-914a-4050-922b-c6d28d13bb73 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.722680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 235/463] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:58.722680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5592f-914a-4050-922b-c6d28d13bb73 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:58.746384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64fef8-1efc-4963-95f5-9a7c709d147d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:58.768623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:58.792192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a93d6f-c305-4e4e-ba8b-bcfc1d92869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:58.793003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a93d6f-c305-4e4e-ba8b-bcfc1d92869f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.793293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a93d6f-c305-4e4e-ba8b-bcfc1d92869f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.793606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a93d6f-c305-4e4e-ba8b-bcfc1d92869f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.805286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a93d6f-c305-4e4e-ba8b-bcfc1d92869f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:58.806865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a93d6f-c305-4e4e-ba8b-bcfc1d92869f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-11a93d6f-c305-4e4e-ba8b-bcfc1d92869f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:45:58.832092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:58.833799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:58.835435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:45:58.835435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:45:58.835435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:45:58.835435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:45:58.835435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 229/464] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:58.835435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780854f-c302-4ffa-9529-51ca91589973 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.835993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780854f-c302-4ffa-9529-51ca91589973 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.835993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780854f-c302-4ffa-9529-51ca91589973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.859811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5780854f-c302-4ffa-9529-51ca91589973 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:58.860896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5780854f-c302-4ffa-9529-51ca91589973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:58.870271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5592f-914a-4050-922b-c6d28d13bb73 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:58.916150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:58.917132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:58.917132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:58.917338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:58.927818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:58.933434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:58.939954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:58.961121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 230/465] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:45:58.967655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:58.968595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:58.969863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:45:58.969863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:45:58.969863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:45:58.969863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:58.969863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 236/466] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:58.969863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:58.970978 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780854f-c302-4ffa-9529-51ca91589973 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:59.104864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:59.116932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780854f-c302-4ffa-9529-51ca91589973 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:59.123570 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd890e3-b9ae-4347-b0ec-90a11952d2f6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:59.172930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:59.173697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.173989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.174272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.174978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:59.175175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:59.175374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:59.175759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.176985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.177282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.177776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:59.178091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:59.178457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:59.180033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:59.193178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 231/467] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:59.197680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:59.206365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 237/468] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:59.207677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:59.278734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:59.340455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3b631-907e-4e37-9e23-df9d02313744 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:59.345189 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f213f-a0d8-4018-a382-beaf7e33fff6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:59.392810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:59.393408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.393730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.394016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.395450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:59.395842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:59.396895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:59.398147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:59.398319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.398802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.399235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.412476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:59.413536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 232/469] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:59.414518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:59.414696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:45:59.436367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:45:59.437277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:45:59.438161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:45:59.438161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:45:59.438161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:45:59.438161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:45:59.438161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 238/470] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:45:59.438418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:59.445043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:59.546718 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e084-4cb2-46a8-a9b8-1798010bb374 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:59.558981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c230c9-f261-4af5-820c-698d9d671051 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:59.560811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:59.593321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36088f8-c0a1-48e2-b290-6a091d096203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:59.594040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36088f8-c0a1-48e2-b290-6a091d096203 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.594331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36088f8-c0a1-48e2-b290-6a091d096203 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.594617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36088f8-c0a1-48e2-b290-6a091d096203 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.595334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36088f8-c0a1-48e2-b290-6a091d096203 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:59.596784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36088f8-c0a1-48e2-b290-6a091d096203 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:59.599673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba98f94-627a-4d8a-bb47-f428addbf55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:59.600341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98f94-627a-4d8a-bb47-f428addbf55c None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.600630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98f94-627a-4d8a-bb47-f428addbf55c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.600911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98f94-627a-4d8a-bb47-f428addbf55c None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.601652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba98f94-627a-4d8a-bb47-f428addbf55c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:59.603137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba98f94-627a-4d8a-bb47-f428addbf55c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:59.617374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 233/471] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:59 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:59.618923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc542e4-f097-4b64-86e3-b2e118d32d4d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.619232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc542e4-f097-4b64-86e3-b2e118d32d4d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.619500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc542e4-f097-4b64-86e3-b2e118d32d4d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.620852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 234/472] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:45:59.621627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc542e4-f097-4b64-86e3-b2e118d32d4d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:59.628683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 239/473] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:59 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:59.633214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba98f94-627a-4d8a-bb47-f428addbf55c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:59.743686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:45:59.796794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc542e4-f097-4b64-86e3-b2e118d32d4d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:59.839612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba98f94-627a-4d8a-bb47-f428addbf55c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:45:59.867712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d508c6-1775-45f4-8084-257c9d27e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:59.868809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d508c6-1775-45f4-8084-257c9d27e3a6 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.869276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d508c6-1775-45f4-8084-257c9d27e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.869815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d508c6-1775-45f4-8084-257c9d27e3a6 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.871097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d508c6-1775-45f4-8084-257c9d27e3a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:59.873235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d508c6-1775-45f4-8084-257c9d27e3a6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:59.901445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:45:59.902480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.902804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.903171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.903822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:45:59.904173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:45:59.906281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:45:59.908477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 235/474] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:59 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:45:59.914114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349370f9-3f93-44ce-86c8-ec7ce95d19ba None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:45:59.914114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349370f9-3f93-44ce-86c8-ec7ce95d19ba None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:45:59.914114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349370f9-3f93-44ce-86c8-ec7ce95d19ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:45:59.928139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 240/475] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:45:59.936057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:45:59.949862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-349370f9-3f93-44ce-86c8-ec7ce95d19ba None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:45:59.951869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-349370f9-3f93-44ce-86c8-ec7ce95d19ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:45:59.981849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:00.093004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 236/476] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:00.126725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6fbc8-e51c-445e-a87a-7d0c025df4da None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:00.128678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349370f9-3f93-44ce-86c8-ec7ce95d19ba None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:00.214955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b8b7-f555-4e13-a07f-325004998485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:00.215952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b8b7-f555-4e13-a07f-325004998485 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:00.216377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b8b7-f555-4e13-a07f-325004998485 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:00.216836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b8b7-f555-4e13-a07f-325004998485 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:00.218924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955b8b7-f555-4e13-a07f-325004998485 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:00.221299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955b8b7-f555-4e13-a07f-325004998485 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:00.222587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:00.262754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 241/477] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:45:59 2022] POST /identity/v3/users => generated 249 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:46:00.282193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349370f9-3f93-44ce-86c8-ec7ce95d19ba None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:00.346441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:00.347203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:00.347447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:00.347745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:00.349007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:00.350724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:00.358906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.sql.core [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 12:46:00.358906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 08 12:46:00.358906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [parameters: {'id': '19931a1edb544b809cb10633f8510902', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 08 12:46:00.358906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80223) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jun 08 12:46:00.380517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return ref.to_dict() Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 12:46:00.382216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application yield resource Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise self.value Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application session.commit() Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 12:46:00.383948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.flush() Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application compat.raise_( Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 12:46:00.385339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 12:46:00.389348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 12:46:00.390831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [parameters: {'id': '19931a1edb544b809cb10633f8510902', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:00.391794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 08 12:46:00.404950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:00.410113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 237/478] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 8 12:46:00 2022] POST /identity/v3/roles => generated 144 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:00.410779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b8b7-f555-4e13-a07f-325004998485 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:00.511543 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:00.547793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b8b7-f555-4e13-a07f-325004998485 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:00.588728 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bdda6-188f-4bdd-b798-048d8f370d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:00.589610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bdda6-188f-4bdd-b798-048d8f370d32 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:00.589929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bdda6-188f-4bdd-b798-048d8f370d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:00.590257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bdda6-188f-4bdd-b798-048d8f370d32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:00.603121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bdda6-188f-4bdd-b798-048d8f370d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3b4bdda6-188f-4bdd-b798-048d8f370d32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:00.611600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:00.615010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:00.617602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 242/479] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:00.622632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:00.808392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c2f0c-d6c1-4d7d-8f1d-29e24b946174 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:00.841181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:00.867176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cc2ab-4121-4da8-ac3d-8ebf92d16b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:00.868173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc2ab-4121-4da8-ac3d-8ebf92d16b27 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:00.868713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc2ab-4121-4da8-ac3d-8ebf92d16b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:00.869105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc2ab-4121-4da8-ac3d-8ebf92d16b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:00.870404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cc2ab-4121-4da8-ac3d-8ebf92d16b27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:00.870935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cc2ab-4121-4da8-ac3d-8ebf92d16b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:00.873408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cc2ab-4121-4da8-ac3d-8ebf92d16b27 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:00.885729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 238/480] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:02.977063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48dc56-4856-4712-ae4d-14bfdc19ce76 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:02.977646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48dc56-4856-4712-ae4d-14bfdc19ce76 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:02.977646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48dc56-4856-4712-ae4d-14bfdc19ce76 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:02.979518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 243/481] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:02.989468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b321b3b-c676-4aac-b4cb-c975ce5000ac None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:02.990243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b321b3b-c676-4aac-b4cb-c975ce5000ac None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:02.990243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b321b3b-c676-4aac-b4cb-c975ce5000ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.008510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0a08-79a7-45e4-85fd-5f46cb793816 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.008884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0a08-79a7-45e4-85fd-5f46cb793816 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.009280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0a08-79a7-45e4-85fd-5f46cb793816 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.011103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 244/482] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:46:03.020047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9b321b3b-c676-4aac-b4cb-c975ce5000ac None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:03.021396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9b321b3b-c676-4aac-b4cb-c975ce5000ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:03.023360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621bd2b-e22b-4fa5-9598-49e9e75a9156 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.023659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621bd2b-e22b-4fa5-9598-49e9e75a9156 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.023948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621bd2b-e22b-4fa5-9598-49e9e75a9156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.066879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8621bd2b-e22b-4fa5-9598-49e9e75a9156 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:03.068119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8621bd2b-e22b-4fa5-9598-49e9e75a9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:03.141278 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 239/483] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:03.180173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 245/484] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:03.185297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b321b3b-c676-4aac-b4cb-c975ce5000ac None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:03.219134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621bd2b-e22b-4fa5-9598-49e9e75a9156 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:03.372323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b321b3b-c676-4aac-b4cb-c975ce5000ac None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:03.378614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:03.403897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:03.442522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419ed97-551f-44da-8585-b0b64eb62d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:03.444539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419ed97-551f-44da-8585-b0b64eb62d39 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.445033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419ed97-551f-44da-8585-b0b64eb62d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.445506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419ed97-551f-44da-8585-b0b64eb62d39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.454695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621bd2b-e22b-4fa5-9598-49e9e75a9156 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:03.462605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419ed97-551f-44da-8585-b0b64eb62d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0419ed97-551f-44da-8585-b0b64eb62d39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:03.471368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:03.472361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:03.473810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:03.478331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 240/485] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:03.480968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367b09-84e3-4a3a-aab7-0095498cbd2c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.481508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367b09-84e3-4a3a-aab7-0095498cbd2c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.485324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367b09-84e3-4a3a-aab7-0095498cbd2c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.488379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 241/486] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:03.496094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5367b09-84e3-4a3a-aab7-0095498cbd2c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:03.503664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38d22d-0bf8-497b-9a6c-8c2860530626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:03.504823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d22d-0bf8-497b-9a6c-8c2860530626 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.505632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d22d-0bf8-497b-9a6c-8c2860530626 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.506208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d22d-0bf8-497b-9a6c-8c2860530626 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.519192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38d22d-0bf8-497b-9a6c-8c2860530626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-db38d22d-0bf8-497b-9a6c-8c2860530626 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:03.528816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:03.529804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:03.530618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:03.537840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 246/487] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:03.539722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e92a1-b94b-456f-a355-77c3c00f001d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.540273 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e92a1-b94b-456f-a355-77c3c00f001d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.540790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e92a1-b94b-456f-a355-77c3c00f001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.561652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fd2e92a1-b94b-456f-a355-77c3c00f001d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:03.563126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fd2e92a1-b94b-456f-a355-77c3c00f001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:03.625513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5367b09-84e3-4a3a-aab7-0095498cbd2c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:03.662037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 247/488] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:03.663248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e92a1-b94b-456f-a355-77c3c00f001d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:03.679411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd677a87-e3c8-4c06-84b9-6680fbb4a1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:03.680859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677a87-e3c8-4c06-84b9-6680fbb4a1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.681430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677a87-e3c8-4c06-84b9-6680fbb4a1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.682383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677a87-e3c8-4c06-84b9-6680fbb4a1f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.683724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd677a87-e3c8-4c06-84b9-6680fbb4a1f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:03.684527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd677a87-e3c8-4c06-84b9-6680fbb4a1f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:03.686679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd677a87-e3c8-4c06-84b9-6680fbb4a1f3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:03.697640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 242/489] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:03.699322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f96cc-ac7a-46a1-a53d-0d53e61a5623 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.699625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f96cc-ac7a-46a1-a53d-0d53e61a5623 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.699947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f96cc-ac7a-46a1-a53d-0d53e61a5623 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.704912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 243/490] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:03.704912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f96cc-ac7a-46a1-a53d-0d53e61a5623 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:03.739884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:03.750404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:03.805652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e92a1-b94b-456f-a355-77c3c00f001d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:03.857945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:03.858936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.859279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.859559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.860480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:03.860801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:03.862275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:03.863742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f96cc-ac7a-46a1-a53d-0d53e61a5623 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:03.872914 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 248/491] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:03.873833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:03.919233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5275d-9bfa-4afb-9a90-cd49d5f1e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:03.920293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5275d-9bfa-4afb-9a90-cd49d5f1e084 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.920831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5275d-9bfa-4afb-9a90-cd49d5f1e084 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.921300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5275d-9bfa-4afb-9a90-cd49d5f1e084 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.943367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5275d-9bfa-4afb-9a90-cd49d5f1e084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3ce5275d-9bfa-4afb-9a90-cd49d5f1e084 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:03.954131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:03.955180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:03.955975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:03.956582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 244/492] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:03.959254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410a20d-7823-4542-be16-cefa25189c00 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:03.959674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410a20d-7823-4542-be16-cefa25189c00 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:03.960127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410a20d-7823-4542-be16-cefa25189c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:03.981486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2410a20d-7823-4542-be16-cefa25189c00 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:03.983146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2410a20d-7823-4542-be16-cefa25189c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:04.040241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec7f72-9ecd-4d75-a3fe-54d383aa67a1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:04.062645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:04.081676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 245/493] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:04.081676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410a20d-7823-4542-be16-cefa25189c00 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.101952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:04.103094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.103681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.104045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.118397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:04.120880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:04.125930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:04.147317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:04.148259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:04.149112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:04.149112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:04.149112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:04.149112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:04.149332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 249/494] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:04.150135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.224125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410a20d-7823-4542-be16-cefa25189c00 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:04.272459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:04.273809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.274276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.274733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.291813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:04.293697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888981-934f-4157-8223-c6ec28ce3137 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:04.294406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:04.333660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:04.334597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:04.335622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:04.335622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:04.335622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:04.335622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:04.335622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 246/495] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:04.336073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.353082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40329b8-c425-4794-81ed-4c841d2e73c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:04.354216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40329b8-c425-4794-81ed-4c841d2e73c3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.354642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40329b8-c425-4794-81ed-4c841d2e73c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.355092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40329b8-c425-4794-81ed-4c841d2e73c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.355879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40329b8-c425-4794-81ed-4c841d2e73c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:04.356197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40329b8-c425-4794-81ed-4c841d2e73c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:04.357626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40329b8-c425-4794-81ed-4c841d2e73c3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:04.372277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 250/496] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:04.373738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d94c13-6a2b-41c4-9094-5b162375583c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.374047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d94c13-6a2b-41c4-9094-5b162375583c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.374336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d94c13-6a2b-41c4-9094-5b162375583c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.375762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 251/497] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:04.376513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d94c13-6a2b-41c4-9094-5b162375583c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.422608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:04.447998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:04.473825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac5b79-4404-4ed8-961d-849811fab21a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:04.507993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d94c13-6a2b-41c4-9094-5b162375583c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:04.515485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b6ecd-e198-461f-a83c-c75da3133a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:04.516428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6ecd-e198-461f-a83c-c75da3133a5e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.516709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6ecd-e198-461f-a83c-c75da3133a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.516987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6ecd-e198-461f-a83c-c75da3133a5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.533405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b6ecd-e198-461f-a83c-c75da3133a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d61b6ecd-e198-461f-a83c-c75da3133a5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:04.544688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:04.545712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:04.546538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 247/498] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:04.547283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b6ecd-e198-461f-a83c-c75da3133a5e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.553576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39e215-2d28-4354-b758-214300754333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:04.554476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39e215-2d28-4354-b758-214300754333 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.554889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39e215-2d28-4354-b758-214300754333 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.555263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39e215-2d28-4354-b758-214300754333 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.556105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39e215-2d28-4354-b758-214300754333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:04.556518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39e215-2d28-4354-b758-214300754333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:04.558626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39e215-2d28-4354-b758-214300754333 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:04.579108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 252/499] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:04.580491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39e215-2d28-4354-b758-214300754333 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.692627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b6ecd-e198-461f-a83c-c75da3133a5e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:04.699221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:04.712107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39e215-2d28-4354-b758-214300754333 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:04.734007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d85f-0731-49f5-925c-d63e7685dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:04.735101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d85f-0731-49f5-925c-d63e7685dbba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.735572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d85f-0731-49f5-925c-d63e7685dbba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.736047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d85f-0731-49f5-925c-d63e7685dbba None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.737332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d85f-0731-49f5-925c-d63e7685dbba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:04.737887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d85f-0731-49f5-925c-d63e7685dbba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:04.741066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d85f-0731-49f5-925c-d63e7685dbba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:04.755056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:04.757577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:04.758487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.758843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.759029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.763890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 248/500] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:04.765410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3815a-a3c3-497e-a403-482821d736e3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.765695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3815a-a3c3-497e-a403-482821d736e3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.765980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3815a-a3c3-497e-a403-482821d736e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.771961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:04.773556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:04.792531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7df3815a-a3c3-497e-a403-482821d736e3 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:04.793966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7df3815a-a3c3-497e-a403-482821d736e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:04.795206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:04.796327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:04.797582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:04.797582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:04.797582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:04.797582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:04.797582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 253/501] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:04.797582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.876947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 249/502] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:04.878104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3815a-a3c3-497e-a403-482821d736e3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.931787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24027a47-a33a-4733-a9ea-f0caa4a6307b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:04.971888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:04.972587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:04.972902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:04.973974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:04.974425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:04.974735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:04.976156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:04.984774 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 254/503] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:04.985619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:04.993314 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:05.011881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3815a-a3c3-497e-a403-482821d736e3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.047085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:05.056983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.057867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.058164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.058441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.067031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.068514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:05.086615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:05.088253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 250/504] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:05.089534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:05.135628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d411127-ec9c-43d7-b13a-773f475deb6e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.174746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.175552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.176033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.176469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.188067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.189688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.204656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a331-bd3d-4d27-9439-358f4a200dbe None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:05.206425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:05.208371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 255/505] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:05.210006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:05.256402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.257099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.257410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.258434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.259364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:05.259699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.261595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.280674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 251/506] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:05.282315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:05.286541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:05.337819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:05.345024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5c6a1-dd90-4f7f-bc4f-8586869900b7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.394046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.395534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.395861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.396185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.401412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8f035-c9f3-45a7-8dbf-27762c9179e2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.412038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.413863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:05.434287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:05.435369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:05.436358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:05.436358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:05.436358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:05.436358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:05.436358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 256/507] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:05.436663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:05.448142 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.449000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.449000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.449934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.464636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.467477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:05.486040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:05.487116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:05.494381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:05.494381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:05.494381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:05.494381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:05.494381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 252/508] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:05.494381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:05.560254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209e276-076b-4a5a-a557-18abced64911 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.578409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:05.603237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.604102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.604558 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.604913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.605172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:05.605866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:05.606227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.608600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.611827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bfbe-140f-4a9b-9a1f-91b5b4167e1d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.648965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.649675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.649977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.650261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.651204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:05.651526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.652996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.654823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 257/509] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:05.654823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:05.710604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 253/510] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:05.712171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:05.791980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81e79-b092-4420-ad21-e2c0a2c786f1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.838344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc908-9f18-4b0a-9f36-83c229b749f9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:05.884681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.885577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.885870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.886152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.886894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:05.887206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.888626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.915929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 254/511] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:05.915929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:05.944078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:05.963700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:05.964511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:05.964801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:05.965090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:05.974096 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:05.981118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:05.991925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:05.993176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 258/512] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:05.999806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:06.037237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:06.058539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74488757-2f93-4a34-b1e6-51b0a6782513 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:06.098288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:06.098920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:06.099161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:06.099451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:06.100678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:06.101216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:06.103456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:06.118379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 255/513] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:06.119233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63bfb-c6ed-461b-a549-0621de08f850 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:06.119826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:06.156619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73923bb5-ae64-4ad1-b08c-9b2d7354449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:06.157264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73923bb5-ae64-4ad1-b08c-9b2d7354449d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:06.157565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73923bb5-ae64-4ad1-b08c-9b2d7354449d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:06.157884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73923bb5-ae64-4ad1-b08c-9b2d7354449d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:06.221327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:06.239819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73923bb5-ae64-4ad1-b08c-9b2d7354449d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:06.241335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73923bb5-ae64-4ad1-b08c-9b2d7354449d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:06.256374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6907c17-0f86-4180-a49d-135c713c348f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:06.278602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:06.297238 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc20e41-fbd8-457d-839e-0a59780ddf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:06.298123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc20e41-fbd8-457d-839e-0a59780ddf29 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:06.298371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc20e41-fbd8-457d-839e-0a59780ddf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:06.298533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc20e41-fbd8-457d-839e-0a59780ddf29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:06.362741 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 259/514] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:06.363518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73923bb5-ae64-4ad1-b08c-9b2d7354449d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:06.387242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc20e41-fbd8-457d-839e-0a59780ddf29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:06.388723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc20e41-fbd8-457d-839e-0a59780ddf29 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:06.481015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:06.495413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73923bb5-ae64-4ad1-b08c-9b2d7354449d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:06.508664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 256/515] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:06.511412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc20e41-fbd8-457d-839e-0a59780ddf29 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:06.539889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2248-d9e0-4a9f-b606-999eb4c566c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:06.540563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2248-d9e0-4a9f-b606-999eb4c566c6 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:06.540847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2248-d9e0-4a9f-b606-999eb4c566c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:06.541120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2248-d9e0-4a9f-b606-999eb4c566c6 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:06.541869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2248-d9e0-4a9f-b606-999eb4c566c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:06.543337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2248-d9e0-4a9f-b606-999eb4c566c6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:06.552693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:06.573281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 260/516] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:46:06 2022] POST /identity/v3/users => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:06.574650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2248-d9e0-4a9f-b606-999eb4c566c6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:06.656759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc20e41-fbd8-457d-839e-0a59780ddf29 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:06.701160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:06.702090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:06.702401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:06.702686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:06.703596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:06.703914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:06.705947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:06.725823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2248-d9e0-4a9f-b606-999eb4c566c6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:06.738584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 257/517] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:46:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:06.738584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:06.787307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:06.788219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:06.789395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:06.789715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:06.790046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:06.798701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:06.800153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:06.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:06.829358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 12:46:06.830362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:06.830891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 261/518] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:06.831383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:06.892090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d989c0-ab68-4c4a-814f-5c45cb6c214b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:06.914587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:06.949188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:06.950583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:06.951046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:06.951510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:06.970301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:06.973510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:07.003700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205ed4c-fdca-46e1-92b5-0fe26370a1b5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:07.076170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:07.077413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:07.077913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:07.078415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:07.100313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:07.102186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:07.124816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:07.126049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:07.126933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:07.126933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:07.126933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:07.126933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:07.129804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:07.131756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:07.133799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:07.133799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:07.133799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:07.133799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:07.134352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 262/519] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:07.134352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:07.135514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 258/520] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:07.136411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:07.246579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:07.263591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcadd1a-cd38-463c-a871-ee2926f80532 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:07.287430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e62bca-9add-4d9e-869a-7c4831170084 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:07.289702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:07.327023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:07.327818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:07.328117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:07.328473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:07.329415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:07.329846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:07.332211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:07.344260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502154ca-30bf-42cf-a0d6-af6b45fd6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:07.344919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502154ca-30bf-42cf-a0d6-af6b45fd6641 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:07.345209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502154ca-30bf-42cf-a0d6-af6b45fd6641 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:07.345492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502154ca-30bf-42cf-a0d6-af6b45fd6641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:07.365271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 259/521] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Jun 8 12:46:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:07.365271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:07.446955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502154ca-30bf-42cf-a0d6-af6b45fd6641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:07.448425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502154ca-30bf-42cf-a0d6-af6b45fd6641 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:07.492619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b61d82-2d71-42b7-b0f2-2ac87d8385af None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:07.538341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:07.538996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:07.539291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:07.539578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:07.540327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:07.540640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:07.542084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:07.558235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 260/522] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:07.559163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:07.576835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:07.604004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 263/523] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:07.605423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502154ca-30bf-42cf-a0d6-af6b45fd6641 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:07.609369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:07.711786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f06739-613e-48c5-8975-e5a060706cd0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:07.758019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:07.758621 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:07.759202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:07.759202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:07.759903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:07.760788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:07.762617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:07.767636 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502154ca-30bf-42cf-a0d6-af6b45fd6641 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:07.781297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 261/524] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:07.782320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:07.813205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576a471-adc9-4449-9e99-cac445f62fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:07.813695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576a471-adc9-4449-9e99-cac445f62fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:07.814046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576a471-adc9-4449-9e99-cac445f62fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:07.814269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576a471-adc9-4449-9e99-cac445f62fb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:07.885192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:07.921237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576a471-adc9-4449-9e99-cac445f62fb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:07.928534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576a471-adc9-4449-9e99-cac445f62fb2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:07.930328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:07.944110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa4b3-e584-4bab-9aed-ebe76c5093fb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:07.984049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:07.984873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:07.985260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:07.985567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:07.994979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:07.996446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:08.012131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:08.013136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:08.014082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 262/525] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:08.014557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.110520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 264/526] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:08.111388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576a471-adc9-4449-9e99-cac445f62fb2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.165358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde110cf-2875-42a3-8784-1dcabb11a213 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:08.196949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:08.208310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:08.209088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:08.209376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:08.209692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:08.223667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:08.225135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:08.239174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576a471-adc9-4449-9e99-cac445f62fb2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:08.242409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:08.243619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:08.244764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:08.246028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:08.246028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:08.246028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:08.246028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:08.249849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 263/527] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:08.250842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.287960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:08.290625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:08.291123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:08.291691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:08.302305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:08.305433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:08.320484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:08.321381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:08.322260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 265/528] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:08.323250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.372444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c121a-c0d2-41ec-baca-6d809b9ab2ff None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:08.422752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:08.423562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:08.423856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:08.424144 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:08.424944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:08.425260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:08.428608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:08.448805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 264/529] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:08.449702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.474164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557b570-3856-4c72-a6bd-9083c155be94 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:08.497360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:08.516365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:08.517511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:08.518017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:08.518475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:08.532388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:08.534317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:08.554617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:08.555536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:08.556391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:08.556391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:08.556391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:08.556391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:08.558358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 266/530] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:08.559451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.582713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad7039-3645-4893-b08c-1cd8973efb45 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:08.583351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:08.624794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:08.625395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:08.625787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:08.626108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:08.626935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:08.627252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:08.628742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:08.649087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 265/531] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:08.649960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.718652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab637224-0ed2-4857-b0ad-d1eab5ce6529 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:08.778872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:08.779817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:08.780368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:08.780801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:08.782181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:08.782732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:08.784987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:08.796957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:08.805436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c31ea-c235-4616-b4c3-55a1882e7c68 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:08.817643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 267/532] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:08.817643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.863953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:08.864943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:08.865221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:08.865497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:08.866639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=d83990f7249442a582403e654a2278f3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:08.866974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:08.868427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:08.881768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 266/533] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/role_assignments?user.id=d83990f7249442a582403e654a2278f3&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:08.881768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:08.976022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:09.055432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd585291-1ee6-4403-9f83-bac21c51443a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:09.072984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a33e7f-9eac-44ee-8992-2849553ded29 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:09.112902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:09.114654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.115212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.115634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.117502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:09.117502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:09.120230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:09.130809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:09.132276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.132784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.133568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.141756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 268/534] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:09.144550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:09.144871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:09.146442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:09.174655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:09.176270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:09.177371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 267/535] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:09.178360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:09.214039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:09.286149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97694bf-363b-4554-ad20-6c8484fa0e93 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:09.338523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71068dde-7aa7-4a2f-83d8-2f6bfd2fa7ba None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:09.346046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa17a-b363-48dd-8d77-c4b428914da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:09.347106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa17a-b363-48dd-8d77-c4b428914da0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.347655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa17a-b363-48dd-8d77-c4b428914da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.348150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa17a-b363-48dd-8d77-c4b428914da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.349748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa17a-b363-48dd-8d77-c4b428914da0 None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=998c7b05ebe64f5c95bcb86a49e673ec) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:09.350299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa17a-b363-48dd-8d77-c4b428914da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:09.352967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa17a-b363-48dd-8d77-c4b428914da0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:09.356581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:09.373675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 269/536] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:09 2022] GET /identity/v3/role_assignments?user.id=998c7b05ebe64f5c95bcb86a49e673ec&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:09.376035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f04a-c08b-4141-b44d-46b7589880e7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.376339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f04a-c08b-4141-b44d-46b7589880e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.376632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f04a-c08b-4141-b44d-46b7589880e7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.378865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 270/537] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:09.380286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346f04a-c08b-4141-b44d-46b7589880e7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:09.405315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1b9d8-690d-41e9-9a35-bd89e59de22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:09.405571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b9d8-690d-41e9-9a35-bd89e59de22a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.405733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b9d8-690d-41e9-9a35-bd89e59de22a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.406037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b9d8-690d-41e9-9a35-bd89e59de22a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.417681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1b9d8-690d-41e9-9a35-bd89e59de22a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:09.419212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1b9d8-690d-41e9-9a35-bd89e59de22a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a0b1b9d8-690d-41e9-9a35-bd89e59de22a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:09.435356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:09.436268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:09.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 268/538] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:09.438045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017b66e-a5ff-4d8b-a211-3285d6315028 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.441583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017b66e-a5ff-4d8b-a211-3285d6315028 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.441583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017b66e-a5ff-4d8b-a211-3285d6315028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.465771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f017b66e-a5ff-4d8b-a211-3285d6315028 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:09.467124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f017b66e-a5ff-4d8b-a211-3285d6315028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:09.585503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 269/539] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:09.586929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017b66e-a5ff-4d8b-a211-3285d6315028 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:09.592158 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346f04a-c08b-4141-b44d-46b7589880e7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:09.617398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:09.661971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:09.662698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.663055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.665599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.665599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:09.665599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:09.666699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:09.682435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 271/540] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:09.683419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:09.745251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017b66e-a5ff-4d8b-a211-3285d6315028 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:09.766849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:09.803328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:09.805945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.806633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.807269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.810302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:09.811464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:09.815477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:09.836915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed78a23-5cd2-48eb-b1a7-8db1dd865231 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:09.851614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 270/541] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:09.851614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:09.908527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4880-bc17-4263-9a58-738d3a372813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:09.911143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4880-bc17-4263-9a58-738d3a372813 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:09.912658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4880-bc17-4263-9a58-738d3a372813 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:09.913779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4880-bc17-4263-9a58-738d3a372813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:09.939785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb4880-bc17-4263-9a58-738d3a372813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fffb4880-bc17-4263-9a58-738d3a372813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:09.951698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:09.952826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:09.953822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:09.957422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 272/542] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:09.958771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4880-bc17-4263-9a58-738d3a372813 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:09.978340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:10.014221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726855d-7884-48e0-b6c1-993e141df0b6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:10.071178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:10.073267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:10.073944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:10.075084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:10.077697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=63fe1877e3334a29b3bdfa0ba22174da) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:10.078521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:10.080262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:10.088410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 271/543] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:09 2022] GET /identity/v3/role_assignments?user.id=63fe1877e3334a29b3bdfa0ba22174da&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:10.090026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:10.130172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4880-bc17-4263-9a58-738d3a372813 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:10.158942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:10.183491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:10.184933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:10.186102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:10.186659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:10.188087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=98d7ac35d0e846af97f3ca345ec2ac09) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:10.188644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:10.190703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:10.199872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 273/544] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:09 2022] GET /identity/v3/role_assignments?user.id=98d7ac35d0e846af97f3ca345ec2ac09&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:10.318208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f678490-20b2-4290-8cc9-f907a99db2c1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:10.394411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:10.395859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:10.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:10.397130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:10.398536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:10.399028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:10.401844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:10.430258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:10.439610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 272/545] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:10.448261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:10.585619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f1f31-1641-4778-b8e0-53370ef89ccb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:10.649217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:10.650120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:10.650352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:10.650633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:10.666899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:10.668626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:10.714832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:10.715740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:10.717327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:10.717327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:10.717327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:10.717327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:10.717327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 274/546] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:10.722325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:10.923096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146155c-e11d-4762-9883-b46b845e4369 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:10.986700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:10.987292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:10.987575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:10.987886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:10.989705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:10.990024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:10.992486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:11.007058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 273/547] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:11.012325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:11.074506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:11.205913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0404-3c01-4ac8-82d9-bc384c496d22 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:11.276744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:11.277968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:11.278465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:11.279028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:11.292666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:11.294549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:11.313102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:11.314642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:11.315708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:11.319107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 275/548] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:11.325743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:11.436160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:11.513605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39302c0a-dceb-4bb6-94b2-c45bc589942e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:11.570321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d360199-b74a-4ff8-b4ee-84a135e12aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:11.571411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360199-b74a-4ff8-b4ee-84a135e12aae None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:11.571871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360199-b74a-4ff8-b4ee-84a135e12aae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:11.572312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360199-b74a-4ff8-b4ee-84a135e12aae None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:11.573714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d360199-b74a-4ff8-b4ee-84a135e12aae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:11.574208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d360199-b74a-4ff8-b4ee-84a135e12aae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:11.576571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d360199-b74a-4ff8-b4ee-84a135e12aae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:11.612116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 274/549] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 8 12:46:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:11.623450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:11.810217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:11.821346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb7aee-70bf-4881-aabb-37090f979aee None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:11.871014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b180c2a-17b5-4188-8dd8-1fd7b1680501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:11.871719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180c2a-17b5-4188-8dd8-1fd7b1680501 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:11.872014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180c2a-17b5-4188-8dd8-1fd7b1680501 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:11.872304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180c2a-17b5-4188-8dd8-1fd7b1680501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:12.009948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b180c2a-17b5-4188-8dd8-1fd7b1680501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:12.011576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b180c2a-17b5-4188-8dd8-1fd7b1680501 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:12.026985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479ce9-f7ae-4d89-a767-d73a2c2b5ee5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:12.027434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479ce9-f7ae-4d89-a767-d73a2c2b5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:12.027589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479ce9-f7ae-4d89-a767-d73a2c2b5ee5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:12.029228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 275/550] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:46:12.035319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c119b-6d99-42a0-a9ca-f84b9c116b91 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:12.035790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c119b-6d99-42a0-a9ca-f84b9c116b91 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:12.036193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c119b-6d99-42a0-a9ca-f84b9c116b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:12.063297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-475c119b-6d99-42a0-a9ca-f84b9c116b91 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:12.064524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-475c119b-6d99-42a0-a9ca-f84b9c116b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:12.178417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:12.184866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 276/551] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:12.190495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b180c2a-17b5-4188-8dd8-1fd7b1680501 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:12.244365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 276/552] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:46:12.290798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c119b-6d99-42a0-a9ca-f84b9c116b91 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:12.393963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:12.417370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b180c2a-17b5-4188-8dd8-1fd7b1680501 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:12.526474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:12.527683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:12.528198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:12.528701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:12.549590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:12.553883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:12.581289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c119b-6d99-42a0-a9ca-f84b9c116b91 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:12.596452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:12.598764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:12.600418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:12.600418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:12.600418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:12.600418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:12.601401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 277/553] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:12.607235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:12.698382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab33a-2403-4e74-a0f8-910cb1e01eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:12.699232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab33a-2403-4e74-a0f8-910cb1e01eac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:12.699523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab33a-2403-4e74-a0f8-910cb1e01eac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:12.699807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab33a-2403-4e74-a0f8-910cb1e01eac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:12.730598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ab33a-2403-4e74-a0f8-910cb1e01eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:12.731711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b56ab33a-2403-4e74-a0f8-910cb1e01eac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:12.738970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:12.742752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:12.746711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:12.754025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 277/554] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:12.757129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab33a-2403-4e74-a0f8-910cb1e01eac None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:12.840425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4650e-5d1d-4ef0-aa3c-0cb5945ca666 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:12.910891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:12.911575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:12.911850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:12.912110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:12.912866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:12.914799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:12.916223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:12.954253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 278/555] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:12.960038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:12.979035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab33a-2403-4e74-a0f8-910cb1e01eac None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:12.993109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:13.037040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b8ff8-1ce6-4730-b975-dceeadf9012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:13.037843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b8ff8-1ce6-4730-b975-dceeadf9012b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.038133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b8ff8-1ce6-4730-b975-dceeadf9012b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.038452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b8ff8-1ce6-4730-b975-dceeadf9012b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.039592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b8ff8-1ce6-4730-b975-dceeadf9012b None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:13.039906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b8ff8-1ce6-4730-b975-dceeadf9012b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:13.041703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b8ff8-1ce6-4730-b975-dceeadf9012b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:13.057793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 278/556] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:13.060208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e6e8-ee1e-4050-9fd9-91a3ef62c51b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.060730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e6e8-ee1e-4050-9fd9-91a3ef62c51b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.061959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e6e8-ee1e-4050-9fd9-91a3ef62c51b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.064600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 279/557] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:13.069868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624e6e8-ee1e-4050-9fd9-91a3ef62c51b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:13.145452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f9d4-d01c-4b7b-9145-59c3e0bdba16 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:13.163808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:13.220367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e80e-49b6-441b-b8db-87f1863ef658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:13.221624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e80e-49b6-441b-b8db-87f1863ef658 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.222099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e80e-49b6-441b-b8db-87f1863ef658 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.223295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e80e-49b6-441b-b8db-87f1863ef658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.232383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22e80e-49b6-441b-b8db-87f1863ef658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:13.234353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22e80e-49b6-441b-b8db-87f1863ef658 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8a22e80e-49b6-441b-b8db-87f1863ef658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:13.252219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:13.253669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:13.254756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:13.254756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:13.254756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:13.254756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:13.254756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:13.254756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:13.254756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:13.254756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:13.257584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 279/558] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:13.259231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9720b-60ba-427b-a5ef-f53e896b69ef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.259775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9720b-60ba-427b-a5ef-f53e896b69ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.260256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9720b-60ba-427b-a5ef-f53e896b69ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.269582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624e6e8-ee1e-4050-9fd9-91a3ef62c51b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:13.281433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c0f9720b-60ba-427b-a5ef-f53e896b69ef None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:13.283105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c0f9720b-60ba-427b-a5ef-f53e896b69ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:13.317510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:13.319888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.320420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.320894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.347723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:13.349759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:13.371023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:13.371995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:13.372992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:13.372992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:13.372992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:13.372992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:13.381023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 280/559] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:13.382467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:13.415972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 280/560] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:13.417104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9720b-60ba-427b-a5ef-f53e896b69ef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:13.418880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:13.546775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859981d-7ebb-4e92-9fde-e82aad1a92e6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:13.555057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:13.563013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9720b-60ba-427b-a5ef-f53e896b69ef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:13.618203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:13.619297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.619772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.620247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.621582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:13.622105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:13.623192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca40994-7008-4d9a-8141-94751dcbc834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:13.624511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40994-7008-4d9a-8141-94751dcbc834 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.625237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40994-7008-4d9a-8141-94751dcbc834 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.625923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40994-7008-4d9a-8141-94751dcbc834 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.626111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:13.627660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40994-7008-4d9a-8141-94751dcbc834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:13.628884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40994-7008-4d9a-8141-94751dcbc834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:13.631431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40994-7008-4d9a-8141-94751dcbc834 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:13.651270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 281/561] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:13.652722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:13.653224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 281/562] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:13.656920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683303-3fc4-4451-9bfe-8a723ca96618 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.656920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683303-3fc4-4451-9bfe-8a723ca96618 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.656920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683303-3fc4-4451-9bfe-8a723ca96618 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.659348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 282/563] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:13.661314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46683303-3fc4-4451-9bfe-8a723ca96618 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:13.784689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:13.815232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46683303-3fc4-4451-9bfe-8a723ca96618 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:13.820109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73cc10-0316-4dc9-a572-9cf3123f9698 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:13.866256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:13.868157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.868502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.868788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.872849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11302a1-4f40-4c1a-b223-c4df89f05855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:13.873780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11302a1-4f40-4c1a-b223-c4df89f05855 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.874282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11302a1-4f40-4c1a-b223-c4df89f05855 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.874820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11302a1-4f40-4c1a-b223-c4df89f05855 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.885441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:13.888136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:13.906580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:13.907590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:13.908522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 283/564] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:13.911732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:13.913309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11302a1-4f40-4c1a-b223-c4df89f05855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a11302a1-4f40-4c1a-b223-c4df89f05855 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:13.930818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:13.931803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:13.932718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:13.933344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 282/565] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:13.936302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566e0e-fdcc-4ca5-90c0-2215d8000286 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:13.943013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566e0e-fdcc-4ca5-90c0-2215d8000286 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:13.943013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566e0e-fdcc-4ca5-90c0-2215d8000286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:13.966415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1d566e0e-fdcc-4ca5-90c0-2215d8000286 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:13.967624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1d566e0e-fdcc-4ca5-90c0-2215d8000286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:13.985992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:14.058671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 283/566] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:14.059459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d566e0e-fdcc-4ca5-90c0-2215d8000286 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:14.080341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac2973-6e14-414e-85c6-5f254202534a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:14.125742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:14.126777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.127231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.127680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.129707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=1706af7489064b9f9087b740249630b2) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:14.130226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:14.132784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:14.142455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 284/567] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:13 2022] GET /identity/v3/role_assignments?user.id=1706af7489064b9f9087b740249630b2&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:14.143769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:14.160524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:14.215713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d566e0e-fdcc-4ca5-90c0-2215d8000286 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:14.274643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beca0cc-347d-49a3-816d-c94f2315457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:14.275543 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca0cc-347d-49a3-816d-c94f2315457a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.275810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca0cc-347d-49a3-816d-c94f2315457a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.276095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca0cc-347d-49a3-816d-c94f2315457a None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.276957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beca0cc-347d-49a3-816d-c94f2315457a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:14.277524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beca0cc-347d-49a3-816d-c94f2315457a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:14.278794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beca0cc-347d-49a3-816d-c94f2315457a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:14.303843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 284/568] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 8 12:46:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:14.304905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d4327-fd8d-49b2-9f00-0f6175abe938 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:14.305320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb8cd6-f3d1-478e-a14f-6c964613e8c7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.305733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb8cd6-f3d1-478e-a14f-6c964613e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.306020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb8cd6-f3d1-478e-a14f-6c964613e8c7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.307726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 285/569] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:14.309136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb8cd6-f3d1-478e-a14f-6c964613e8c7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:14.315709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:14.354221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:14.355047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.355409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.355769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.356615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:14.356992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:14.358496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:14.367794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 285/570] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:14.369496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:14.461305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb8cd6-f3d1-478e-a14f-6c964613e8c7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:14.465669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:14.506258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52daaa-af26-4284-9ddc-76ee89a91d51 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:14.509080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6480e-b089-4845-9cb4-0f6a3088d74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:14.510516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6480e-b089-4845-9cb4-0f6a3088d74d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.511016 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6480e-b089-4845-9cb4-0f6a3088d74d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.517666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6480e-b089-4845-9cb4-0f6a3088d74d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.529984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6480e-b089-4845-9cb4-0f6a3088d74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-14c6480e-b089-4845-9cb4-0f6a3088d74d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:14.538033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:14.539178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:14.540123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 286/571] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:14.541406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0389a-6c89-4d92-b60f-aca1da8722ea None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.541406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0389a-6c89-4d92-b60f-aca1da8722ea None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.541406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0389a-6c89-4d92-b60f-aca1da8722ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.556432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:14.557317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.557679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.557966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.559407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d9d0389a-6c89-4d92-b60f-aca1da8722ea None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:14.560533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d9d0389a-6c89-4d92-b60f-aca1da8722ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:14.575039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:14.576917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:14.595781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:14.596738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:14.597922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:14.597922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:14.597922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:14.597922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:14.597922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 286/572] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:14.598489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:14.650245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:14.666030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 287/573] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:14.667744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0389a-6c89-4d92-b60f-aca1da8722ea None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:14.746009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f16058-f3e1-4ebc-8136-33d2f97fde12 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:14.771142 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:14.790683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:14.791652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.791936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.792678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.804801 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:14.806309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:14.815776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0389a-6c89-4d92-b60f-aca1da8722ea None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:14.824328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:14.825224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:14.826462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:14.826462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:14.826462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:14.826462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:14.826462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 287/574] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:14.826747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:14.863386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:14.864079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:14.864565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:14.865005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:14.865872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:14.866196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:14.868015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:14.882671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 288/575] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:14.882671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:14.948895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:14.958740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d193d2-1816-44d5-b80d-532698fbd5b6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.001408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.002117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.002409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.002693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.003569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:15.004037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.005830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.017884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 288/576] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:15.018715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.020326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c6d41-1e5c-42e6-b59e-851e70506f4c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.062855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:15.089447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3c44-5725-4a71-9f76-d0cd6d2955b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.090968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3c44-5725-4a71-9f76-d0cd6d2955b3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.090968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3c44-5725-4a71-9f76-d0cd6d2955b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.090968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3c44-5725-4a71-9f76-d0cd6d2955b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.103753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b3c44-5725-4a71-9f76-d0cd6d2955b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c83b3c44-5725-4a71-9f76-d0cd6d2955b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:15.111681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:15.112873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:15.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 289/577] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:15.114971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3c44-5725-4a71-9f76-d0cd6d2955b3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.168083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b859-9d3f-4710-9a2c-3cad90c42d9a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.204905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.205632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.205932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.206236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.207628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:15.207944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.209343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.228985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 289/578] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:15.229769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.249905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3c44-5725-4a71-9f76-d0cd6d2955b3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.272029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:15.296821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.297655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.297946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.298227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.318675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.320157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:15.338594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:15.339657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:15.340561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:15.340561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:15.340561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:15.340561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:15.344421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 290/579] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:15.345283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.353189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:15.381281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03816b-287d-4946-9717-3a5860092ba9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.443969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.445293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.445831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.446213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.454049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.455526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:15.471272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:15.472812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 290/580] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:15.474518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.490601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811b50-4007-4130-9c82-b26fc11af3d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.535196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.536007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.536298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.536580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.537337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:15.537684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.539635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.549902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 291/581] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:15.551439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.594083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:15.599622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434442-d750-4ac0-8ace-85af3f672324 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.645022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.646402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.646903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.647406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.660635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.663337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.678050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05268d7c-8bbb-4852-a526-e9a231854a1a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:15.689931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:15.691318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:15.692698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 291/582] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:15.693724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.714937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:15.726444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.727133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.727417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.727694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.728427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:15.728738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.730386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.747942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 292/583] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:15.749455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.832147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352748f7-b2fe-4dc1-965c-a4033da42602 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.856191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:15.871436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304de1ee-88be-4acd-8f9c-3ee463c77469 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:15.872790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.873462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.873792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.874088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.874884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:15.875199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.876658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.889629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 292/584] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:15.890303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.918804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:15.919718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:15.919901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:15.920186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:15.933141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:15.934776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:15.954458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:15.956002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:15.958842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:15.958842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:15.958842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:15.958842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:15.958842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 293/585] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:15.958842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:15.971344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:16.014185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4e17-e1fb-4a96-ae72-064251956e18 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.055448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:16.056125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.056400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.056902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.057518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:16.057858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:16.059281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:16.087554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 293/586] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:16.088413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:16.098042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b913-8410-42f9-8dfa-be230acb0357 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.150122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:16.150987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.151371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.151657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.162235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:16.163882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:16.180580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:16.189467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 294/587] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:16.192727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:16.246371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f6c2c-5c8a-41e7-aa8b-7a0595ffd391 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.280075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:16.292854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de23613-6989-44c3-b9b0-fc3b122d818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:16.293787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23613-6989-44c3-b9b0-fc3b122d818c None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.294082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23613-6989-44c3-b9b0-fc3b122d818c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.294362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23613-6989-44c3-b9b0-fc3b122d818c None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/d83990f7249442a582403e654a2278f3/roles/ea6c0a1f7c484564aacab2eb0e62eef9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.312174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de23613-6989-44c3-b9b0-fc3b122d818c None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=d83990f7249442a582403e654a2278f3, role_id=ea6c0a1f7c484564aacab2eb0e62eef9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:16.313721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de23613-6989-44c3-b9b0-fc3b122d818c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:16.324154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a4bb1-f178-42f6-b7b8-b7a515b34b7f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.328856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 294/588] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:46:16 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/d83990f7249442a582403e654a2278f3/roles/ea6c0a1f7c484564aacab2eb0e62eef9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:46:16.342560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de23613-6989-44c3-b9b0-fc3b122d818c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:16.367568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:16.368371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.368581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.368825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.369721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:16.370643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:16.371844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:16.398457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 295/589] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:16.399489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:16.488960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de23613-6989-44c3-b9b0-fc3b122d818c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.496961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:16.534367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:16.535805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.536255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.536635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.548907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:16.552077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:16.571247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc22e0-7c78-4f34-99e8-3c9ddf378132 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:16.577719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:16.578917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:16.580061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:16.580061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:16.580061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:16.580061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:16.580572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 295/590] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:16.581944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:16.618780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23ee4c-2038-4565-b712-ca3d961da991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:16.619779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ee4c-2038-4565-b712-ca3d961da991 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.620220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ee4c-2038-4565-b712-ca3d961da991 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.620659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ee4c-2038-4565-b712-ca3d961da991 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.620817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:16.622361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23ee4c-2038-4565-b712-ca3d961da991 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:16.623238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23ee4c-2038-4565-b712-ca3d961da991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:16.626143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23ee4c-2038-4565-b712-ca3d961da991 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:16.651474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 296/591] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Jun 8 12:46:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:16.652994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f8fa4-3dd3-437e-b9b2-f68c85e28bc0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.653199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f8fa4-3dd3-437e-b9b2-f68c85e28bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.653428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f8fa4-3dd3-437e-b9b2-f68c85e28bc0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.654929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 297/592] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:16.655448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f8fa4-3dd3-437e-b9b2-f68c85e28bc0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:16.719470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829659-599a-49ba-b92c-8fc0e649b268 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.762404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:16.763321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.763611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.763891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.773954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:16.776712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:16.786495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f8fa4-3dd3-437e-b9b2-f68c85e28bc0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:16.793923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:16.795106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:16.796804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:16.799749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 296/593] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:46:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:16.801165 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:16.814221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:16.840062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a651e11-8545-441d-8c80-a377fc525262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:16.841212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a651e11-8545-441d-8c80-a377fc525262 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.841753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a651e11-8545-441d-8c80-a377fc525262 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.842254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a651e11-8545-441d-8c80-a377fc525262 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.843407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a651e11-8545-441d-8c80-a377fc525262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:16.843746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a651e11-8545-441d-8c80-a377fc525262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:16.846387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a651e11-8545-441d-8c80-a377fc525262 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:16.874447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 298/594] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:16.874447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e385-9869-41de-94da-dd59260cef8a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:16.874447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e385-9869-41de-94da-dd59260cef8a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:16.874447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e385-9869-41de-94da-dd59260cef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:16.891011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dde8e385-9869-41de-94da-dd59260cef8a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:16.892548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dde8e385-9869-41de-94da-dd59260cef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:16.940305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:16.952334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f3c5a-9dee-49b6-8739-7f5a16f7e2c2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:16.975446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 299/595] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:16.976339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e385-9869-41de-94da-dd59260cef8a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.013059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.013906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.014189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.014465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.026952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.028413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:17.049911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:17.051426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:17.052993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:17.052993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:17.052993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:17.052993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:17.057288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 297/596] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:17.058064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.115769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e385-9869-41de-94da-dd59260cef8a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.130188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:17.161470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.162304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.163056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.163430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.164639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:17.165018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.167046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:17.182070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc0fce-e924-4b93-b8bf-3d8c5def49fa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.193166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 300/597] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:46:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:17.193166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.224650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.225531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.225796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.226416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.233593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.235044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:17.250907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:17.252104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:17.253192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:17.253192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:17.253192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:17.253192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:17.253192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:17.253192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:17.253192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:17.253192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:17.257438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 298/598] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:17.258379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.261336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:17.326197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1373e4-440e-4b87-8bbe-ade2c4c43f0c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.366236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a909-f703-4706-ab14-5411c1a71bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.367345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a909-f703-4706-ab14-5411c1a71bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.367599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a909-f703-4706-ab14-5411c1a71bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.367885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a909-f703-4706-ab14-5411c1a71bd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.378207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c369db5-2fd2-44ab-8526-2787ec5298e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.380205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a909-f703-4706-ab14-5411c1a71bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4975a909-f703-4706-ab14-5411c1a71bd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:17.388141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:17.389333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 301/599] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:17.390479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a909-f703-4706-ab14-5411c1a71bd0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.423905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.424672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.425051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.426220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.426967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:17.427284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.428673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:17.433134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:17.441790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 299/600] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:17.442676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.514898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:17.521977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a909-f703-4706-ab14-5411c1a71bd0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.560475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.561199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331e51d-dd9c-404b-8c56-09503a94558c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.561333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.561569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.561866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.579861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.581427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:17.599957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:17.600900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:17.601860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:17.601860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:17.601860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:17.601860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:17.601860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 302/601] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:17.602630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.607839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.608549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.608836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.609116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.609974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:17.610295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.611785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:17.637635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 300/602] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:17.637635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.708328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:17.740029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e9c9-78ea-4e1b-b548-d902c6a24797 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.753266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc3fb-1a64-4868-a368-fa2e575f8708 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.778790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:17.793068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.793784 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.794080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.794368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.795137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:17.795453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.796838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:17.799388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.801584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.802104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.802607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.811090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 303/603] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:17.811872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.814452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.818008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:17.844155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:17.845107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:17.846027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:17.846027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:17.846027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:17.846027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:17.846027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:17.846027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:17.846027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:17.846027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:17.846454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 301/604] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:17.848146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:17.940291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486ec3-3f6d-46da-80ce-37c8e502b17e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:17.982134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:17.983199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:17.983666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:17.984133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:17.985578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:17.986114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:17.989067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.010438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96310328-7341-4d03-96f9-0c5b2c83c2e9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:18.016823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 304/605] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:18.016823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:18.019507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:18.052739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e017c-abcb-4e32-a0fe-cd7c8c52349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:18.053634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e017c-abcb-4e32-a0fe-cd7c8c52349a None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.053926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e017c-abcb-4e32-a0fe-cd7c8c52349a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.054208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e017c-abcb-4e32-a0fe-cd7c8c52349a None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/998c7b05ebe64f5c95bcb86a49e673ec/roles/ea6c0a1f7c484564aacab2eb0e62eef9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.069676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e017c-abcb-4e32-a0fe-cd7c8c52349a None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=998c7b05ebe64f5c95bcb86a49e673ec, role_id=ea6c0a1f7c484564aacab2eb0e62eef9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:18.071144 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e017c-abcb-4e32-a0fe-cd7c8c52349a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.086313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 302/606] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:46:17 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/998c7b05ebe64f5c95bcb86a49e673ec/roles/ea6c0a1f7c484564aacab2eb0e62eef9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:46:18.087444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e017c-abcb-4e32-a0fe-cd7c8c52349a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:18.142650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:18.166268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a56a90-3402-4c31-b6d5-657870f1f8b4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:18.220674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:18.221687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.222660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.223205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.240768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:18.242790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.267094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e017c-abcb-4e32-a0fe-cd7c8c52349a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:18.275975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:18.277302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:18.278561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:18.278561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:18.278561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:18.278561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:18.285871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 305/607] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:18.287071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:18.330947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:18.332211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.332693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.333322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.334174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:18.335384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:18.336892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.354951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 303/608] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:18.356152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:18.365276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:18.430464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe4f9c-1a3f-4097-a4c8-ef13460f15c9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:18.475007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:18.475838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.476124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.476403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.484985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:18.486635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.494378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:18.505027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b488-bd99-442b-b68a-015f5858a389 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:18.506625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:18.507703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:18.508786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:18.508786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:18.508786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:18.508786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:18.508786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:18.508786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:18.508786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:18.508786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:18.511644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 306/609] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:18.512699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:18.552435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:18.553116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.553409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.553723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.554879 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:18.555412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:18.558673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.574998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 304/610] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:18.575974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:18.649923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1eafe-fdd6-4799-bd4b-5eb075ab4804 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:18.668898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:18.694520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19399793-4ccd-4cf9-aa79-b5e9b6548db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:18.695766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19399793-4ccd-4cf9-aa79-b5e9b6548db2 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.696217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19399793-4ccd-4cf9-aa79-b5e9b6548db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.696642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19399793-4ccd-4cf9-aa79-b5e9b6548db2 None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/98d7ac35d0e846af97f3ca345ec2ac09/roles/ea6c0a1f7c484564aacab2eb0e62eef9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.715220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19399793-4ccd-4cf9-aa79-b5e9b6548db2 None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=98d7ac35d0e846af97f3ca345ec2ac09, role_id=ea6c0a1f7c484564aacab2eb0e62eef9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:18.715462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75982-a687-44e2-9b57-b30ce72e52a6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:18.717098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19399793-4ccd-4cf9-aa79-b5e9b6548db2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.737281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 307/611] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:46:18 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/98d7ac35d0e846af97f3ca345ec2ac09/roles/ea6c0a1f7c484564aacab2eb0e62eef9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:46:18.739106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19399793-4ccd-4cf9-aa79-b5e9b6548db2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:18.787934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:18.788830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.789604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.789917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.790891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:18.791319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:18.792971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.836212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 305/612] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:18.844805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:18.869813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:18.880468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19399793-4ccd-4cf9-aa79-b5e9b6548db2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:18.924516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b3c52-57c9-4ca7-b911-a25084f10d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:18.927033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b3c52-57c9-4ca7-b911-a25084f10d90 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.927563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b3c52-57c9-4ca7-b911-a25084f10d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.928121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b3c52-57c9-4ca7-b911-a25084f10d90 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.937495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b3c52-57c9-4ca7-b911-a25084f10d90 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:18.939364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b3c52-57c9-4ca7-b911-a25084f10d90 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f86b3c52-57c9-4ca7-b911-a25084f10d90 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:18.959085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:18.960653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:18.961709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:18.964220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 308/613] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:18.966091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191335-904f-449c-ae53-d9b711a03191 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:18.966545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191335-904f-449c-ae53-d9b711a03191 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:18.966991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191335-904f-449c-ae53-d9b711a03191 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:18.968845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 309/614] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:18.969748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50191335-904f-449c-ae53-d9b711a03191 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:19.004116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:19.044102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77dd9d-c684-4134-882c-bb34a3ac3b2d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:19.100484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50191335-904f-449c-ae53-d9b711a03191 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:19.110427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df03de-841b-4d34-8146-333c2a3c211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:19.112429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df03de-841b-4d34-8146-333c2a3c211e None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:19.113740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df03de-841b-4d34-8146-333c2a3c211e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:19.114421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df03de-841b-4d34-8146-333c2a3c211e None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/63fe1877e3334a29b3bdfa0ba22174da/roles/ea6c0a1f7c484564aacab2eb0e62eef9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:19.147009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2a5da-638f-4245-8a6d-516e87063bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:19.147701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2a5da-638f-4245-8a6d-516e87063bfd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:19.148118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2a5da-638f-4245-8a6d-516e87063bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:19.148284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2a5da-638f-4245-8a6d-516e87063bfd None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:19.149094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2a5da-638f-4245-8a6d-516e87063bfd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:19.149402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2a5da-638f-4245-8a6d-516e87063bfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:19.151216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2a5da-638f-4245-8a6d-516e87063bfd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:19.152524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df03de-841b-4d34-8146-333c2a3c211e None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=63fe1877e3334a29b3bdfa0ba22174da, role_id=ea6c0a1f7c484564aacab2eb0e62eef9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:19.155573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df03de-841b-4d34-8146-333c2a3c211e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:19.174337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 310/615] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 8 12:46:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:19.176139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b0280-c79c-4297-80f6-895f33289759 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:19.176530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b0280-c79c-4297-80f6-895f33289759 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:19.176822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b0280-c79c-4297-80f6-895f33289759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:19.185363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 306/616] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:46:18 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/63fe1877e3334a29b3bdfa0ba22174da/roles/ea6c0a1f7c484564aacab2eb0e62eef9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:46:19.194415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df03de-841b-4d34-8146-333c2a3c211e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:19.195799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-113b0280-c79c-4297-80f6-895f33289759 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:19.197146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-113b0280-c79c-4297-80f6-895f33289759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:19.281043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 311/617] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:19.321490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b0280-c79c-4297-80f6-895f33289759 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:19.351092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:19.351772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:19.450175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df03de-841b-4d34-8146-333c2a3c211e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:19.519081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:19.520246 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:19.520723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:19.521276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:19.550525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:19.561575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:19.581031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b0280-c79c-4297-80f6-895f33289759 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:19.588173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:19.589973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:19.591957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:19.591957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:19.591957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:19.591957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:19.594649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 307/618] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:19.597621 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:19.627333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae1cf1-9d45-4116-969c-7bc5ac29c46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:19.628668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae1cf1-9d45-4116-969c-7bc5ac29c46b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:19.629180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae1cf1-9d45-4116-969c-7bc5ac29c46b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:19.629834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae1cf1-9d45-4116-969c-7bc5ac29c46b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:19.644270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae1cf1-9d45-4116-969c-7bc5ac29c46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e3ae1cf1-9d45-4116-969c-7bc5ac29c46b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:19.653595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:19.654721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:19.656100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 312/619] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:19.661801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae1cf1-9d45-4116-969c-7bc5ac29c46b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:19.779084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea9dda-990d-47bb-a3e0-f8af0907b119 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:19.813954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:19.814657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:19.858356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae1cf1-9d45-4116-969c-7bc5ac29c46b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:19.869578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:19.870374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:19.870672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:19.870954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:19.871701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:19.872012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:19.873642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:19.896951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:19.897592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:19.898019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:19.898408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:19.899290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:19.899703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:19.901991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:19.903845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 308/620] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:19.912388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:19.921664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 313/621] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:19.923138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:20.030866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08833140-e74a-4120-b626-954a6aff8b2d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:20.084469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:20.086943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:20.087645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:20.089000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:20.093464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:20.118200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:20.120384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:20.154519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:20.155466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:20.156356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:20.156356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:20.156356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:20.156356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:20.158655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 314/622] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:20.166184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:20.173189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed049a49-bdf0-47e0-aadd-a76c741eed47 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:20.211078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:20.211896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:20.212186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:20.212469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:20.223906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:20.223906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:20.240135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:20.242208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:20.244231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:20.244231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:20.244231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:20.244231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:20.244231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:20.244231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:20.244231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:20.244231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:20.245045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 309/623] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:20.251517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:20.331767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7666-1906-4964-8e36-9f353fd403b0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:20.349949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:20.396577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:20.397269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:20.397576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:20.397877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:20.398622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:20.398933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:20.400352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:20.415144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 315/624] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:20.422573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:20.478754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:20.539877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91400c16-97ad-4024-b954-5c6f3f61f696 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:20.578441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:20.579809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:20.580198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:20.580576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:20.589907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:20.591569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:20.608959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:20.610032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:20.611296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 316/625] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:20.618004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:20.643622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605632-a26f-45b2-86d7-2c362f89de5d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:20.734887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:20.735584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:20.735872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:20.736152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:20.736972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:20.737284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:20.739317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:20.778850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 310/626] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:20.783726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:20.823860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d7e29-a5b3-426a-b9bb-2f6008be8a14 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:20.842029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:20.904638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:20.905929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:20.906388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:20.906841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:20.908729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:20.909389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:20.912504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:20.913223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:20.922423 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c922e-40e1-4c9b-820c-bfa21f87e895 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:20.963969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 317/627] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 8 12:46:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:20.970625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888febf7-acec-42a6-8114-828b8f02dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:20.971564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888febf7-acec-42a6-8114-828b8f02dd59 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:20.972367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888febf7-acec-42a6-8114-828b8f02dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:20.972745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888febf7-acec-42a6-8114-828b8f02dd59 None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/1706af7489064b9f9087b740249630b2/roles/ea6c0a1f7c484564aacab2eb0e62eef9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:20.974649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:20.993096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888febf7-acec-42a6-8114-828b8f02dd59 None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=1706af7489064b9f9087b740249630b2, role_id=ea6c0a1f7c484564aacab2eb0e62eef9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:20.995250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888febf7-acec-42a6-8114-828b8f02dd59 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:21.014504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 311/628] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:46:20 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/1706af7489064b9f9087b740249630b2/roles/ea6c0a1f7c484564aacab2eb0e62eef9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:46:21.122459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9201-79f3-4cab-a9d5-0dd43af3800e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:21.122931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9201-79f3-4cab-a9d5-0dd43af3800e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:21.123313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d9201-79f3-4cab-a9d5-0dd43af3800e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:21.125415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 312/629] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:21.133818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734f10-1ef6-4ec9-99ad-dd9f6f6b7153 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:21.133818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734f10-1ef6-4ec9-99ad-dd9f6f6b7153 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:21.133818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734f10-1ef6-4ec9-99ad-dd9f6f6b7153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:21.170970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-45734f10-1ef6-4ec9-99ad-dd9f6f6b7153 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:21.174822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-45734f10-1ef6-4ec9-99ad-dd9f6f6b7153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:21.235261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc82c8d-024b-402d-ac26-9996598074b9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:21.323933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba2915-fe36-43d6-a9a8-ef15045d6d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:21.324684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba2915-fe36-43d6-a9a8-ef15045d6d2f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:21.324983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba2915-fe36-43d6-a9a8-ef15045d6d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:21.325251 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba2915-fe36-43d6-a9a8-ef15045d6d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:21.354652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 313/630] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:21.377162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:21.380290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45734f10-1ef6-4ec9-99ad-dd9f6f6b7153 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:21.432528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba2915-fe36-43d6-a9a8-ef15045d6d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:21.434115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba2915-fe36-43d6-a9a8-ef15045d6d2f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:21.500288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:21.551569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45734f10-1ef6-4ec9-99ad-dd9f6f6b7153 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:21.602969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 318/631] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:21.609943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba2915-fe36-43d6-a9a8-ef15045d6d2f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:21.631322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5995-63fd-4367-abfd-a9e9d05366a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:21.632097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5995-63fd-4367-abfd-a9e9d05366a2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:21.632386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5995-63fd-4367-abfd-a9e9d05366a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:21.632670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5995-63fd-4367-abfd-a9e9d05366a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:21.655628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e5995-63fd-4367-abfd-a9e9d05366a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-552e5995-63fd-4367-abfd-a9e9d05366a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:21.667910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:21.669095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:21.670160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:21.675608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 314/632] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:21.678389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5995-63fd-4367-abfd-a9e9d05366a2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:21.789927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:21.841042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5995-63fd-4367-abfd-a9e9d05366a2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:21.887381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9aeff-aa55-4224-8963-153661edae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:21.887991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9aeff-aa55-4224-8963-153661edae7d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:21.888278 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9aeff-aa55-4224-8963-153661edae7d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:21.888560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9aeff-aa55-4224-8963-153661edae7d None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:21.889328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9aeff-aa55-4224-8963-153661edae7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:21.889676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9aeff-aa55-4224-8963-153661edae7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:21.891276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9aeff-aa55-4224-8963-153661edae7d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:21.893856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:21.899264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba2915-fe36-43d6-a9a8-ef15045d6d2f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:21.913374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 315/633] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:21.913374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e901-a163-4fe7-846d-763a4050d67b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:21.913374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e901-a163-4fe7-846d-763a4050d67b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:21.913374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e901-a163-4fe7-846d-763a4050d67b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:21.913374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 316/634] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:21.915337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e901-a163-4fe7-846d-763a4050d67b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:21.957667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09c323-2f2f-4878-a0a3-b8fd819d0155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:21.957667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09c323-2f2f-4878-a0a3-b8fd819d0155 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:21.957667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09c323-2f2f-4878-a0a3-b8fd819d0155 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:21.960386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09c323-2f2f-4878-a0a3-b8fd819d0155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:21.974444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09c323-2f2f-4878-a0a3-b8fd819d0155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:21.976470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09c323-2f2f-4878-a0a3-b8fd819d0155 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-df09c323-2f2f-4878-a0a3-b8fd819d0155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:21.998185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:21.999142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:22.000051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:22.000051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:22.000051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:22.000051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:22.002592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 319/635] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:22.004857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beeed9-9c05-4ac0-9593-1e952b02f53a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.005428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beeed9-9c05-4ac0-9593-1e952b02f53a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.005971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beeed9-9c05-4ac0-9593-1e952b02f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.026404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e2beeed9-9c05-4ac0-9593-1e952b02f53a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:22.028025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e2beeed9-9c05-4ac0-9593-1e952b02f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:22.064614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e901-a163-4fe7-846d-763a4050d67b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:22.119346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20546d7d-2b12-4ffd-844e-82bd76f51bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:22.120760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546d7d-2b12-4ffd-844e-82bd76f51bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.121247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546d7d-2b12-4ffd-844e-82bd76f51bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.121765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546d7d-2b12-4ffd-844e-82bd76f51bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.123196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 320/636] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:22.123713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beeed9-9c05-4ac0-9593-1e952b02f53a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:22.145462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20546d7d-2b12-4ffd-844e-82bd76f51bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:22.147011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20546d7d-2b12-4ffd-844e-82bd76f51bf5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-20546d7d-2b12-4ffd-844e-82bd76f51bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:22.166375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:22.167365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:22.168679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:22.168679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:22.168679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:22.168679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:22.168679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 317/637] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:22.169219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af178-7694-4b86-a7e4-75afdbafad00 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.169371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af178-7694-4b86-a7e4-75afdbafad00 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.169678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af178-7694-4b86-a7e4-75afdbafad00 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.173598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 318/638] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:22.173598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407af178-7694-4b86-a7e4-75afdbafad00 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:22.200570 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:22.245520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:22.274881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beeed9-9c05-4ac0-9593-1e952b02f53a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:22.323151 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:22.324008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.324434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.324844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.325923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:22.326363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:22.326891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407af178-7694-4b86-a7e4-75afdbafad00 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:22.328048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:22.345856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 321/639] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:22.345856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:22.376565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3abf-3f7e-4292-87f8-9a389de1d4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:22.377384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3abf-3f7e-4292-87f8-9a389de1d4cd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.377721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3abf-3f7e-4292-87f8-9a389de1d4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.378523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3abf-3f7e-4292-87f8-9a389de1d4cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.395015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e3abf-3f7e-4292-87f8-9a389de1d4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-769e3abf-3f7e-4292-87f8-9a389de1d4cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:22.403131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:22.404139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:22.405000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:22.410470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 319/640] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:22.411537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34c10-0f02-4f24-9e39-df4fa8578707 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.411822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34c10-0f02-4f24-9e39-df4fa8578707 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.412114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34c10-0f02-4f24-9e39-df4fa8578707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.431773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a8f34c10-0f02-4f24-9e39-df4fa8578707 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:22.433025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a8f34c10-0f02-4f24-9e39-df4fa8578707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:22.479359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd3e7d-61e3-4d6f-981f-b535f8792572 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:22.489474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:22.520564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 320/641] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:22.521460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34c10-0f02-4f24-9e39-df4fa8578707 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:22.536945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:22.537814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.538858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.539936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.541287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:22.541841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:22.543360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:22.558354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 322/642] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:22.559454 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:22.577019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:22.667398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34c10-0f02-4f24-9e39-df4fa8578707 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:22.692806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c1451-a249-4b26-a7da-2921158d18c5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:22.704509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:22.705315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.705627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.705917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.714087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:22.715699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:22.730060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:22.731046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:22.732019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:22.732019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:22.732019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:22.732019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:22.732019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:22.732019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:22.732019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:22.732019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:22.732708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:22.732708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.732708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.732708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.733015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:22.733263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:22.734721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:22.735997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 321/643] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:22.736869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:22.744941 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 323/644] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:22.746209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:22.779969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:22.853504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:22.857151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad502-8f62-4e04-86c8-cbc2dadffb48 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:22.874845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b22cc7-c6a5-48f5-b12e-040e3d92f61b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:22.895892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e27c-746f-41ba-838b-ec31a6494ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:22.897134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e27c-746f-41ba-838b-ec31a6494ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.897430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e27c-746f-41ba-838b-ec31a6494ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.897876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e27c-746f-41ba-838b-ec31a6494ca9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.908903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e27c-746f-41ba-838b-ec31a6494ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:22.912009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:22.912876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:22.913178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:22.913466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9aa1e27c-746f-41ba-838b-ec31a6494ca9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:22.917390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:22.921131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:22.922145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:22.923566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 322/645] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:22.924394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:22.924569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e27c-746f-41ba-838b-ec31a6494ca9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:22.926601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:22.944351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:22.947513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 324/646] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:22.950089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:23.060219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e27c-746f-41ba-838b-ec31a6494ca9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.082934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:23.099506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10cf59-c929-4995-b03c-1eb5bc3e7ed6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.112565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.113314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.113665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.114004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.114824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:23.115650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.117396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.131181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 323/647] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:23.132124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:23.145808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.146992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.147459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.147914 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.153001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:23.173166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.176284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:23.210715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:23.212432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:23.214198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:23.214198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:23.214198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:23.214198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:23.217054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 325/648] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:23.218762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:23.249365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcba044-138a-4053-8d3c-3449ceccc229 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.287335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.288023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.288315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.288601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.289357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:23.289716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.291107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.305111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 324/649] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:23.305111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:23.373458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6feee1e-f632-463a-919f-7b06e1712ed7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.402080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:23.428776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c54b8b-bdd4-4b91-9811-3d0cea250dcc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.429812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.430617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.430939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.432269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.432269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:23.432573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.433830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.445622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:23.460024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 326/650] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 8 12:46:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:23.460024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:23.477609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.478284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.478567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.478849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.479688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=d83990f7249442a582403e654a2278f3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:23.480000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.481450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.488662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 325/651] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:23 2022] GET /identity/v3/role_assignments?user.id=d83990f7249442a582403e654a2278f3&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:23.489728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:23.610481 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda220-03a3-47e0-b4f2-961dee7c4681 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.639173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683275-56de-4e61-8d67-ef1e6c25fc6c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.665212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.665963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.666259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.666548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.667308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:23.667625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.669048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.689819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 327/652] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:23.691037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:23.698948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.699773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.700065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.700347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.715778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.717199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.721060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:23.738988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:23.739988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:23.741133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:23.741133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:23.741133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:23.741133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:23.741133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 326/653] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:23.745699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:23.778941 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:23.845210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26699df6-8a6d-4000-92ee-90e9872a0ba4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.893274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2340e-c269-4a76-8cdb-89878a0ac3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.894139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2340e-c269-4a76-8cdb-89878a0ac3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.894424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2340e-c269-4a76-8cdb-89878a0ac3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.894712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2340e-c269-4a76-8cdb-89878a0ac3d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.903173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357eafa-bc61-4762-9643-21b443b2db88 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:23.945790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17801b4a-00bb-4bee-a645-8348d8a31031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:23.946903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17801b4a-00bb-4bee-a645-8348d8a31031 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.947382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17801b4a-00bb-4bee-a645-8348d8a31031 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.947869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17801b4a-00bb-4bee-a645-8348d8a31031 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.958632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17801b4a-00bb-4bee-a645-8348d8a31031 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.960107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17801b4a-00bb-4bee-a645-8348d8a31031 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-17801b4a-00bb-4bee-a645-8348d8a31031 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:23.977555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:23.978745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 12:46:23.980581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:23.982244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2340e-c269-4a76-8cdb-89878a0ac3d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:23.982244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2340e-c269-4a76-8cdb-89878a0ac3d3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:23.984049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 327/654] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:23.985210 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469cad-1c07-4e51-b966-8f2064b259d0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:23.985585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469cad-1c07-4e51-b966-8f2064b259d0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:23.985937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469cad-1c07-4e51-b966-8f2064b259d0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:23.993247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 328/655] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:23.993247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7469cad-1c07-4e51-b966-8f2064b259d0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:24.059612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:24.071917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:24.123423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 328/656] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:24.124135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2340e-c269-4a76-8cdb-89878a0ac3d3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:24.132330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7469cad-1c07-4e51-b966-8f2064b259d0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:24.173281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ad6ce-f8e0-4d43-8611-15081f370a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:24.175187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ad6ce-f8e0-4d43-8611-15081f370a3b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:24.175507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ad6ce-f8e0-4d43-8611-15081f370a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:24.175863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ad6ce-f8e0-4d43-8611-15081f370a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:24.177273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ad6ce-f8e0-4d43-8611-15081f370a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:24.177897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ad6ce-f8e0-4d43-8611-15081f370a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:24.180420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ad6ce-f8e0-4d43-8611-15081f370a3b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:24.195613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 329/657] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:24.197041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ea213-be34-4457-b45a-433594ecf9a7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:24.197221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ea213-be34-4457-b45a-433594ecf9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:24.197489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ea213-be34-4457-b45a-433594ecf9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:24.215781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-da0ea213-be34-4457-b45a-433594ecf9a7 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:24.216977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-da0ea213-be34-4457-b45a-433594ecf9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:24.241885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2340e-c269-4a76-8cdb-89878a0ac3d3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:24.280791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:24.281475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:24.281797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:24.282080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:24.282942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:24.283275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:24.285086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:24.298091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 330/658] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:24.299440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ea213-be34-4457-b45a-433594ecf9a7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:24.317440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 329/659] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Jun 8 12:46:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:24.318758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:24.339355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:24.357842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:24.423700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ea213-be34-4457-b45a-433594ecf9a7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:24.449903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90bff8-44f6-40a4-ba5b-2535ecf45f84 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:24.462201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:24.463228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:24.463754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:24.464316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:24.476502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:24.478379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:24.493378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:24.494628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:24.495075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:24.495369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:24.503665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:24.505250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:24.506751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:24.507714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:24.508731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:24.508731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:24.508731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:24.508731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:24.510321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 331/660] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:24.511301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:24.526515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:24.527663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:24.528710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:24.534127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 330/661] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:46:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:24.535994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:24.637675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:24.638557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:24.643882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd33c1-6958-4ab8-9228-0127064ae1fc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:24.671813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777aa57-f3f2-4a6a-9796-8e79782aefe0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:24.685709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e82d16-dba9-457c-9846-b159a636dd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:24.686376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e82d16-dba9-457c-9846-b159a636dd6d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:24.686665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e82d16-dba9-457c-9846-b159a636dd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:24.686949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e82d16-dba9-457c-9846-b159a636dd6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:24.726473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152b1d-d828-4675-aa2f-5483dde91bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:24.727722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152b1d-d828-4675-aa2f-5483dde91bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:24.728226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152b1d-d828-4675-aa2f-5483dde91bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:24.728700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152b1d-d828-4675-aa2f-5483dde91bd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:24.742868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73152b1d-d828-4675-aa2f-5483dde91bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-73152b1d-d828-4675-aa2f-5483dde91bd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:24.751101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:24.752067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:24.752900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:24.756086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 331/662] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:24.757067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152b1d-d828-4675-aa2f-5483dde91bd7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:24.776995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e82d16-dba9-457c-9846-b159a636dd6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:24.778582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e82d16-dba9-457c-9846-b159a636dd6d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:24.880086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152b1d-d828-4675-aa2f-5483dde91bd7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:24.920622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:24.930303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 332/663] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:24.931077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e82d16-dba9-457c-9846-b159a636dd6d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:24.933160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:24.934025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:24.935143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:24.935436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:24.936178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:24.936489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:24.937897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:24.941399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:24.960223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 332/664] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:24.960223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.065601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e82d16-dba9-457c-9846-b159a636dd6d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.082902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300794b-f799-4176-ab57-a215ae319835 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.119663 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.120348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.120635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.120732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.120917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.121399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.121747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.121884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:25.122144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.122293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.122748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:25.123064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.123621 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.124480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.134334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 333/665] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:25.135189 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.151873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 333/666] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:46:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:25.151873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.217766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:25.224835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:25.275387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06830dd-66a2-41b4-97fc-46e99ceb8757 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.298346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a39c7-579b-4ae7-8e65-f9f6cbdd992d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.329182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.330370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.330906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.331411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.345432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.348496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.356107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.356922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.357212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.357492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.365495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.367238 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:25.373092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:25.374178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:25.375079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:25.375079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:25.375079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:25.375079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:25.375725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 334/667] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:25.376544 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:25.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:25.386956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:25.387837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:25.387837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:25.387837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:25.387837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:25.387837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:25.387837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:25.387837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:25.387837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:25.388267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 334/668] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:25.388822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.513360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d76a-3f4c-4856-b996-bded83b33109 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.517492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb9c4-85a5-467f-a38c-d23ccfea154a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.529009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:25.533382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:25.556720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.557559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.557857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.558140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.571862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.573348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.576927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a962c-3940-4a4b-b718-9f4debfe1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.577686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a962c-3940-4a4b-b718-9f4debfe1046 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.577977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a962c-3940-4a4b-b718-9f4debfe1046 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.578256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a962c-3940-4a4b-b718-9f4debfe1046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:25.593342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:25.594308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:25.595192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:25.595192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:25.595192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:25.595192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:25.595192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 335/669] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:25.595475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.668986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a962c-3940-4a4b-b718-9f4debfe1046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.670814 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a962c-3940-4a4b-b718-9f4debfe1046 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.714531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a17f0-32db-4896-867e-d18d477b292e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.751850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.752531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.752824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.753178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.753947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:25.754300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.755702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.769758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 336/670] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:25.771461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.785267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 335/671] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:25.787290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a962c-3940-4a4b-b718-9f4debfe1046 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.805234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:25.808559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:25.892137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72b01e-c22d-4ddc-ae6d-d4c0a3604aa5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.916168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a962c-3940-4a4b-b718-9f4debfe1046 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:25.944931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.945752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.946040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.946320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.947130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:25.947439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.949389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.956928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:25.958022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:25.958593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:25.959050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:25.960090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:25.960579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:25.962285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:25.966064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 337/672] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:25.966818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:25.978306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 336/673] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:25.979399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.062403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:26.083254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdc983-79e3-4a0a-8262-7262372e4372 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:26.094822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:26.120100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:26.120916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.121203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.121487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.128968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c195e-c9c4-47e5-979e-d154181bedae None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:26.129299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:26.130798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:26.148414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:26.149567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 338/674] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:26.150702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.170821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:26.171637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.171927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.172209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.183367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:26.184837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:26.202594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:26.203620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:26.204928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:26.204928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:26.204928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:26.204928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:26.204928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 337/675] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:26.205281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.263522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a3fab-c9b6-4d20-b18c-5324de11fca9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:26.298890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b51f1-2587-4af6-be83-92897cac6972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:26.299558 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b51f1-2587-4af6-be83-92897cac6972 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.299913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b51f1-2587-4af6-be83-92897cac6972 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.300237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b51f1-2587-4af6-be83-92897cac6972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.301164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b51f1-2587-4af6-be83-92897cac6972 None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=998c7b05ebe64f5c95bcb86a49e673ec) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:26.301360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b51f1-2587-4af6-be83-92897cac6972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:26.302861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b51f1-2587-4af6-be83-92897cac6972 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:26.309219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 339/676] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:26 2022] GET /identity/v3/role_assignments?user.id=998c7b05ebe64f5c95bcb86a49e673ec&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:26.310620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b054b-34c0-41d8-851d-72b46d094751 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.310916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b054b-34c0-41d8-851d-72b46d094751 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.311197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b054b-34c0-41d8-851d-72b46d094751 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.313707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 340/677] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:26.313968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecccbd7-c0ae-46ef-a743-a82b1ae45cfc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:26.314821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b054b-34c0-41d8-851d-72b46d094751 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.335074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:26.356639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:26.365653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:26.366740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.367031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.367315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.376205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:26.377747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:26.395378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:26.396599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 338/678] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:26.397534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.471518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b054b-34c0-41d8-851d-72b46d094751 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:26.513139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f9bc8-f9bf-4c7e-80fb-f01a741fa331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:26.513968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f9bc8-f9bf-4c7e-80fb-f01a741fa331 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.514260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f9bc8-f9bf-4c7e-80fb-f01a741fa331 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.514546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f9bc8-f9bf-4c7e-80fb-f01a741fa331 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.515355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f9bc8-f9bf-4c7e-80fb-f01a741fa331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:26.515677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f9bc8-f9bf-4c7e-80fb-f01a741fa331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:26.517387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f9bc8-f9bf-4c7e-80fb-f01a741fa331 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:26.538390 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 341/679] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:26.540068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073992d-c35f-473d-acb4-1aeeab74c3de None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:26.540449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0209a-6165-4553-aac5-975655650c6e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.542297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0209a-6165-4553-aac5-975655650c6e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.542297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0209a-6165-4553-aac5-975655650c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.562583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-55f0209a-6165-4553-aac5-975655650c6e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:26.563818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-55f0209a-6165-4553-aac5-975655650c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:26.597189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:26.598544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.599423 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.599585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.600574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:26.601031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:26.603727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:26.625013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 339/680] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:26.626143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.648266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:26.662059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 342/681] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:26.662059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0209a-6165-4553-aac5-975655650c6e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.692452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:26.780291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75ae4-28f6-4d2a-8499-bcf4271c83f6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:26.805380 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0209a-6165-4553-aac5-975655650c6e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:26.822432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:26.823381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.823669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.824215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.825490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:26.825827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:26.827294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:26.844774 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:26.845456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:26.847983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:26.847983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:26.848274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=98d7ac35d0e846af97f3ca345ec2ac09) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:26.848723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:26.850208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:26.855433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 340/682] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 8 12:46:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:26.855433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.869735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 343/683] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:26 2022] GET /identity/v3/role_assignments?user.id=98d7ac35d0e846af97f3ca345ec2ac09&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:26.869735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:26.961236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:27.014090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27726d4a-a6a3-4cfe-bfe4-30c20a159e80 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:27.023205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce7b9-5d53-41f1-a1a6-0461c3b8d56a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:27.025535 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:27.062220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:27.063413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:27.063893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:27.064341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:27.068925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:27.069920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:27.070282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:27.070638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:27.071388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:27.072969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:27.074282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:27.076086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:27.088849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:27.090191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:27.091254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:27.097598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 344/684] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Jun 8 12:46:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:27.097598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:27.100969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:27.102124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:27.103053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:27.103053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:27.103053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:27.103053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:27.103053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:27.103053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:27.103053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:27.103053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:27.106688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 341/685] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:27.107664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:27.236828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdfa3d-2221-4f9a-ac96-45769c071eff None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:27.238548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830eb91-2fe4-4aeb-9142-f5cea8071ab0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:27.275929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceb1fc-b20d-4649-bdfe-d39d42897e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:27.276720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb1fc-b20d-4649-bdfe-d39d42897e38 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:27.277078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb1fc-b20d-4649-bdfe-d39d42897e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:27.277451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb1fc-b20d-4649-bdfe-d39d42897e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:27.281919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:27.288452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:27.289154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:27.289440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:27.289755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:27.290489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:27.290802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:27.292900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:27.305570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 342/686] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 8 12:46:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:27.305570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:27.355709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:27.387925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ceb1fc-b20d-4649-bdfe-d39d42897e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:27.389907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ceb1fc-b20d-4649-bdfe-d39d42897e38 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:27.497904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f65f-3032-451d-b86c-55646beef033 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:27.536899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 345/687] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:27.536899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceb1fc-b20d-4649-bdfe-d39d42897e38 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:27.554524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:27.555582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:27.556081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:27.556617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:27.558050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:27.558568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:27.560615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:27.577972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 343/688] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:27.579319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:27.587129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:27.727358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceb1fc-b20d-4649-bdfe-d39d42897e38 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:27.732826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:27.745469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ab049-4ba4-416d-a2eb-8bec49fcbc0d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:27.769468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:27.770576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:27.771108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:27.771584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:27.772571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:27.773086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:27.774831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:27.789581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 346/689] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 8 12:46:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:27.789581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:27.791013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:27.791942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:27.792228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:27.792506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:27.822917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:27.824772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:27.858522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:27.859482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:27.860353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:27.860353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:27.860353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:27.860353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:27.860353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 344/690] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:27.869323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:28.012908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:28.029001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ef5fd-9e0c-4fc4-b67a-132f5937cdfc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:28.030788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ac0e-8b89-42f8-9ad0-7940c4846d6a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:28.072411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:28.073571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:28.074095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:28.074578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:28.075701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=63fe1877e3334a29b3bdfa0ba22174da) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:28.076217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:28.077907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:28.086471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 347/691] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:27 2022] GET /identity/v3/role_assignments?user.id=63fe1877e3334a29b3bdfa0ba22174da&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:28.089508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:28.090540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:28.091030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:28.091511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:28.092496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:28.093077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:28.094853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:28.116607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 345/692] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:28.122342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:28.250008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e37248-3e17-470d-aed6-4026e6c77fe8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:28.289317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:28.290590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:28.291083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:28.291583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:28.300718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:28.302593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:28.318989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:28.319933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:28.320814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:28.320814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:28.320814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:28.320814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:28.320814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:28.320814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:28.320814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:28.320814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:28.323428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 348/693] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:28.329184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:28.333858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:28.457011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb404aef-3081-4ce7-81d7-b1d61d2228a4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:28.507376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047555-e169-4ddb-b253-36323fdac317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:28.508527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047555-e169-4ddb-b253-36323fdac317 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:28.508527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047555-e169-4ddb-b253-36323fdac317 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:28.508775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047555-e169-4ddb-b253-36323fdac317 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:28.509598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13047555-e169-4ddb-b253-36323fdac317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:28.509986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13047555-e169-4ddb-b253-36323fdac317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:28.511368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13047555-e169-4ddb-b253-36323fdac317 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:28.526795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 346/694] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:28.533052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:28.551776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:28.661232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e9de5-65b3-4694-ae68-35c04c234aa8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:28.701953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c5647-97cd-47d1-83a9-e0cb88940f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:28.703009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5647-97cd-47d1-83a9-e0cb88940f29 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:28.703558 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5647-97cd-47d1-83a9-e0cb88940f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:28.704090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5647-97cd-47d1-83a9-e0cb88940f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:28.705233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c5647-97cd-47d1-83a9-e0cb88940f29 None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=1706af7489064b9f9087b740249630b2) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:28.706378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c5647-97cd-47d1-83a9-e0cb88940f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:28.708199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c5647-97cd-47d1-83a9-e0cb88940f29 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:28.715905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 349/695] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:28 2022] GET /identity/v3/role_assignments?user.id=1706af7489064b9f9087b740249630b2&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:29.086965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadcfd0-b9c4-40d0-8804-083ece1f9551 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:29.087526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadcfd0-b9c4-40d0-8804-083ece1f9551 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:29.087651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadcfd0-b9c4-40d0-8804-083ece1f9551 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:29.089804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 347/696] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:29.098399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e846-6eaa-4683-852e-e92e2cbb6f21 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:29.099096 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e846-6eaa-4683-852e-e92e2cbb6f21 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:29.099549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e846-6eaa-4683-852e-e92e2cbb6f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:29.125433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e2f6e846-6eaa-4683-852e-e92e2cbb6f21 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:29.126845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e2f6e846-6eaa-4683-852e-e92e2cbb6f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:29.226757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 350/697] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:29.254611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadcfd0-b9c4-40d0-8804-083ece1f9551 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:29.336568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:29.388651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadcfd0-b9c4-40d0-8804-083ece1f9551 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:29.431290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82dfc8-7558-4550-aaca-4b3975cf0e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:29.432157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82dfc8-7558-4550-aaca-4b3975cf0e33 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:29.432446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82dfc8-7558-4550-aaca-4b3975cf0e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:29.432728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82dfc8-7558-4550-aaca-4b3975cf0e33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:29.445111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82dfc8-7558-4550-aaca-4b3975cf0e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:29.446909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82dfc8-7558-4550-aaca-4b3975cf0e33 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ac82dfc8-7558-4550-aaca-4b3975cf0e33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:29.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:29.470192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:29.472941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:29.472941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:29.472941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:29.472941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:29.472941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 348/698] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:29.482733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e846-6eaa-4683-852e-e92e2cbb6f21 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:29.491738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:29.655526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e846-6eaa-4683-852e-e92e2cbb6f21 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:29.667254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10d28-f069-4a51-a828-856babf7e4f1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:29.667572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10d28-f069-4a51-a828-856babf7e4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:29.667851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10d28-f069-4a51-a828-856babf7e4f1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:29.669684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 349/699] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:29.683505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb464-1746-43df-8067-e396d5a6ccc8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:29.683801 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb464-1746-43df-8067-e396d5a6ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:29.684055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb464-1746-43df-8067-e396d5a6ccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:29.699488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:29.700167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:29.700459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:29.700744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:29.701489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:29.701856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:29.703265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:29.716377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 351/700] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:29.720714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f3ddb464-1746-43df-8067-e396d5a6ccc8 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:29.721708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:29.723842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f3ddb464-1746-43df-8067-e396d5a6ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:29.826211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:29.859489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 350/701] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 12:46:29.865764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf98f0-c40d-4e18-aeeb-b08d1c3e429e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:29.905651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddb464-1746-43df-8067-e396d5a6ccc8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:29.915640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda592-e106-4bd2-9983-eec77af136a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:29.916336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda592-e106-4bd2-9983-eec77af136a7 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:29.916635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda592-e106-4bd2-9983-eec77af136a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:29.916920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda592-e106-4bd2-9983-eec77af136a7 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:29.917668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda592-e106-4bd2-9983-eec77af136a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:29.919145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda592-e106-4bd2-9983-eec77af136a7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:29.953274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 352/702] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:46:29 2022] POST /identity/v3/users => generated 254 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:46:29.985268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:30.079692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddb464-1746-43df-8067-e396d5a6ccc8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:30.129313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:30.130339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:30.130624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:30.130908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:30.131647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:30.133078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:30.149181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:30.150271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:30.151111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 351/703] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:29 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:30.156830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda592-e106-4bd2-9983-eec77af136a7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:30.276069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda592-e106-4bd2-9983-eec77af136a7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:30.301650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:30.315715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502bc5-f53d-4485-8d46-6c68c35b1a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:30.316409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502bc5-f53d-4485-8d46-6c68c35b1a55 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:30.316698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502bc5-f53d-4485-8d46-6c68c35b1a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:30.316984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502bc5-f53d-4485-8d46-6c68c35b1a55 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:30.317750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502bc5-f53d-4485-8d46-6c68c35b1a55 None admin] RBAC: Adding query filter params (name=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:30.318070 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502bc5-f53d-4485-8d46-6c68c35b1a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:30.319469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502bc5-f53d-4485-8d46-6c68c35b1a55 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:30.325455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 353/704] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:46:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:30.330523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:30.452507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dd2f2-000d-4c1c-9e4e-235485cd43a5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:30.464365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:30.493657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49edaa5-5013-41d2-9b68-8f47cd7bff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:30.494350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edaa5-5013-41d2-9b68-8f47cd7bff48 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:30.494643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edaa5-5013-41d2-9b68-8f47cd7bff48 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:30.494930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edaa5-5013-41d2-9b68-8f47cd7bff48 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:30.495663 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49edaa5-5013-41d2-9b68-8f47cd7bff48 None admin] RBAC: Adding query filter params (type=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:30.495977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49edaa5-5013-41d2-9b68-8f47cd7bff48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:30.497434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49edaa5-5013-41d2-9b68-8f47cd7bff48 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:30.504428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 352/705] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:46:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:30.832828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75246104-1dbc-4cc5-b348-64a42a90a824 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:30.833457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75246104-1dbc-4cc5-b348-64a42a90a824 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:30.833737 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75246104-1dbc-4cc5-b348-64a42a90a824 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:30.835507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 354/706] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:30.841414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae1b1-9718-4a62-a596-bd514073da71 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:30.841870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae1b1-9718-4a62-a596-bd514073da71 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:30.842259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae1b1-9718-4a62-a596-bd514073da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:30.861765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-267ae1b1-9718-4a62-a596-bd514073da71 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:30.863751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-267ae1b1-9718-4a62-a596-bd514073da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:30.953669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 353/707] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:30.973124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75246104-1dbc-4cc5-b348-64a42a90a824 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:31.147969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75246104-1dbc-4cc5-b348-64a42a90a824 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:31.222173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a33b97-d733-4758-816d-4ed1ca9bcb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:31.223798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a33b97-d733-4758-816d-4ed1ca9bcb9c None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:31.224589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a33b97-d733-4758-816d-4ed1ca9bcb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:31.225169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a33b97-d733-4758-816d-4ed1ca9bcb9c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:31.226235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a33b97-d733-4758-816d-4ed1ca9bcb9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:31.227902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a33b97-d733-4758-816d-4ed1ca9bcb9c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:31.251804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 355/708] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:46:30 2022] POST /identity/v3/services => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:31.547325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f45b9-c74a-40b8-aef9-6787d42a3fb0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:31.547861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f45b9-c74a-40b8-aef9-6787d42a3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:31.547952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f45b9-c74a-40b8-aef9-6787d42a3fb0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:31.549589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 354/709] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:31.555758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011967c-2a4c-4397-a3f7-59ab7aecd718 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:31.556062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011967c-2a4c-4397-a3f7-59ab7aecd718 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:31.556354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011967c-2a4c-4397-a3f7-59ab7aecd718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:31.574771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2011967c-2a4c-4397-a3f7-59ab7aecd718 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:31.576002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2011967c-2a4c-4397-a3f7-59ab7aecd718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:31.640408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:31.689039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 356/710] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:31.724593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f45b9-c74a-40b8-aef9-6787d42a3fb0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:31.886733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f45b9-c74a-40b8-aef9-6787d42a3fb0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:31.888437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:31.934929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d273720-33cf-47d5-9c25-2ea13fbf0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:31.935756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273720-33cf-47d5-9c25-2ea13fbf0f17 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:31.936042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273720-33cf-47d5-9c25-2ea13fbf0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:31.936320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273720-33cf-47d5-9c25-2ea13fbf0f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:31.952680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d273720-33cf-47d5-9c25-2ea13fbf0f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2d273720-33cf-47d5-9c25-2ea13fbf0f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:31.961263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:31.962358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:31.963280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 355/711] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:31.970509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011967c-2a4c-4397-a3f7-59ab7aecd718 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:32.135499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8804-589f-4950-af8a-47ae0be12b2e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:32.135782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8804-589f-4950-af8a-47ae0be12b2e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:32.136243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8804-589f-4950-af8a-47ae0be12b2e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:32.138044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 356/712] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:46:32.143713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ba77c-41da-4b4b-9b56-7dbf61c5f506 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:32.144251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ba77c-41da-4b4b-9b56-7dbf61c5f506 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:32.144735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ba77c-41da-4b4b-9b56-7dbf61c5f506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:32.149694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011967c-2a4c-4397-a3f7-59ab7aecd718 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:32.163074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2c6ba77c-41da-4b4b-9b56-7dbf61c5f506 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:32.164506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2c6ba77c-41da-4b4b-9b56-7dbf61c5f506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:32.196356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:32.197047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:32.197340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:32.197654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:32.198424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:32.198740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:32.200172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:32.218632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 357/713] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:32.225470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:32.301931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:32.322843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 357/714] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:32.345992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ba77c-41da-4b4b-9b56-7dbf61c5f506 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:32.456634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481c75-a611-433f-804e-2a5d514f8f74 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:32.522006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:32.524108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:32.525155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:32.525673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:32.526170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:32.544209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ba77c-41da-4b4b-9b56-7dbf61c5f506 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:32.552120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:32.553922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:32.580301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:32.582169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:32.583602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:32.583602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:32.583602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:32.583602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:32.586033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 358/715] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:32.591959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:32.621043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2ba8b-4eab-4cbd-97fc-64d5eae24021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:32.623422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2ba8b-4eab-4cbd-97fc-64d5eae24021 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:32.624738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2ba8b-4eab-4cbd-97fc-64d5eae24021 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:32.625240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2ba8b-4eab-4cbd-97fc-64d5eae24021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:32.648271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2ba8b-4eab-4cbd-97fc-64d5eae24021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d7c2ba8b-4eab-4cbd-97fc-64d5eae24021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:32.657057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:32.658037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:32.658919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:32.667089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 358/716] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:32.677612 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2ba8b-4eab-4cbd-97fc-64d5eae24021 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:32.791769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:32.797427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2ba8b-4eab-4cbd-97fc-64d5eae24021 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:32.826008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3708-bc84-4253-ab2c-6c5ce146394c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:32.836813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:32.837937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:32.838467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:32.838963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:32.840043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:32.840567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:32.842280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:32.852871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 359/717] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:32.862359 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:32.900276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:32.913106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:32.914171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:32.914618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:32.915050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:32.915957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:32.916421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:32.918113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:32.945335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 359/718] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:32.951394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:33.023275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a7557-1551-4ad7-a8fc-ce2ad8ae038b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:33.064550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:33.066679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.067644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.068242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.086381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:33.087860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:33.121276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:33.122386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:33.123326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:33.123326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:33.123326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:33.123326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:33.123326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 360/719] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:33.124748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17459a-6647-4e45-8610-9fbc195dcdc5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:33.129374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:33.177841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657cfd-4c50-4649-a337-2dfa807ae903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:33.179059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657cfd-4c50-4649-a337-2dfa807ae903 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.179562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657cfd-4c50-4649-a337-2dfa807ae903 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.180042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657cfd-4c50-4649-a337-2dfa807ae903 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.190591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657cfd-4c50-4649-a337-2dfa807ae903 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:33.192614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657cfd-4c50-4649-a337-2dfa807ae903 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f8657cfd-4c50-4649-a337-2dfa807ae903 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:33.215876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:33.216886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:33.217913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:33.219241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 360/720] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:46:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:33.220580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41631415-1b4f-4df3-9efb-150991e836ba None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.220866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41631415-1b4f-4df3-9efb-150991e836ba None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.221146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41631415-1b4f-4df3-9efb-150991e836ba None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.223136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 361/721] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:33.227011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:33.229348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3619f-f01e-4430-a978-2deee89620d7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.229731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3619f-f01e-4430-a978-2deee89620d7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.230021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3619f-f01e-4430-a978-2deee89620d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.244042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:33.250836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-74d3619f-f01e-4430-a978-2deee89620d7 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:33.252100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-74d3619f-f01e-4430-a978-2deee89620d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:33.281789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78f77a-5ea5-44f8-8a08-225646969305 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:33.325314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:33.326381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.326850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.327270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.328131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:33.328606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:33.330302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:33.346227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 361/723] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:33.348516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:33.351538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 362/723] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:33.352709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3619f-f01e-4430-a978-2deee89620d7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:33.480966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3619f-f01e-4430-a978-2deee89620d7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:33.504605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34bc5f-aa27-4bc0-b53d-c66bb645a6f5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:33.519767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:33.520934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.521376 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.521783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.536908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:33.538953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:33.553339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:33.566011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:33.571401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:33.572871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.573632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.574361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.576035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:33.576601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:33.578911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:33.579456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:33.580381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:33.581423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:33.582022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 363/724] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:33.583623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:33.614168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 362/725] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:46:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:33.615617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:33.736375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56651-9bc1-4320-bee4-a539bd5f7057 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:33.765102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a1dee-5585-4d7e-acba-fe8fa24a715e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:33.786314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:33.787900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.787900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.787900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.788614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:33.789019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:33.792227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:33.817493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6ed3-25a4-497d-a900-b32623210d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:33.818431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ed3-25a4-497d-a900-b32623210d6c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.818730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ed3-25a4-497d-a900-b32623210d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.819015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ed3-25a4-497d-a900-b32623210d6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.822159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 363/726] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 8 12:46:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:33.823737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:33.835498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b6ed3-25a4-497d-a900-b32623210d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c35b6ed3-25a4-497d-a900-b32623210d6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:33.849572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:33.851059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:33.852025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 364/727] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:33.852865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13068eea-f7ca-4f38-a8b2-ed3cca198056 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:33.852865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13068eea-f7ca-4f38-a8b2-ed3cca198056 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:33.852865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13068eea-f7ca-4f38-a8b2-ed3cca198056 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:33.855348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 365/728] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:33.855348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13068eea-f7ca-4f38-a8b2-ed3cca198056 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:33.893286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:33.937270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:33.981311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf5362-9235-4041-a0c4-49a4eb4097fa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:34.023644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13068eea-f7ca-4f38-a8b2-ed3cca198056 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:34.026922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b37ad-21ac-4603-ba67-ae430929ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:34.027609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b37ad-21ac-4603-ba67-ae430929ed1b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.027896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b37ad-21ac-4603-ba67-ae430929ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.028174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b37ad-21ac-4603-ba67-ae430929ed1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.071959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e2e87-7b80-4348-b942-d51936276e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:34.072799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e2e87-7b80-4348-b942-d51936276e06 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.073211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e2e87-7b80-4348-b942-d51936276e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.073526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e2e87-7b80-4348-b942-d51936276e06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.138809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b37ad-21ac-4603-ba67-ae430929ed1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:34.140254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b37ad-21ac-4603-ba67-ae430929ed1b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:34.169585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e2e87-7b80-4348-b942-d51936276e06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:34.171122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e2e87-7b80-4348-b942-d51936276e06 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:34.210446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:34.233115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:34.290934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 366/729] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:34.291890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e2e87-7b80-4348-b942-d51936276e06 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:34.293980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 364/730] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 12:46:34.297075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f6e97-27c5-4dfd-8cb8-db66aac5f6ec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.297370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f6e97-27c5-4dfd-8cb8-db66aac5f6ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.297677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f6e97-27c5-4dfd-8cb8-db66aac5f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.316597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c10f6e97-27c5-4dfd-8cb8-db66aac5f6ec None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:34.317830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c10f6e97-27c5-4dfd-8cb8-db66aac5f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:34.387841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 365/731] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:34.389271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480a92-9f9b-4128-af60-408dbc764940 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.389512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480a92-9f9b-4128-af60-408dbc764940 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.389825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480a92-9f9b-4128-af60-408dbc764940 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.393202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 366/732] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:34.393202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67480a92-9f9b-4128-af60-408dbc764940 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:34.401634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e2e87-7b80-4348-b942-d51936276e06 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:34.439384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:34.440641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.440947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.441341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.442153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:34.442471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:34.444182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:34.452755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 367/733] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:34.453619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:34.476075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:34.500444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:34.542150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67480a92-9f9b-4128-af60-408dbc764940 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:34.587258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9112d-5efd-4431-8291-76c0c2885a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:34.588001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677afb9e-cafe-42f0-b33a-54ea0a720f28 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:34.588175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9112d-5efd-4431-8291-76c0c2885a08 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.588353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9112d-5efd-4431-8291-76c0c2885a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.588637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9112d-5efd-4431-8291-76c0c2885a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.602094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9112d-5efd-4431-8291-76c0c2885a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:34.603969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9112d-5efd-4431-8291-76c0c2885a08 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-18a9112d-5efd-4431-8291-76c0c2885a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:34.626591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:34.628606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:34.630273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:34.630273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:34.630273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:34.630273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:34.630273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 367/734] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:34.630273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29d19-1bf5-4737-af2f-93c4094d0371 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.630273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29d19-1bf5-4737-af2f-93c4094d0371 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.630809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee29d19-1bf5-4737-af2f-93c4094d0371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.643877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:34.644981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.645283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.645599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.652452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7ee29d19-1bf5-4737-af2f-93c4094d0371 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:34.653831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ee29d19-1bf5-4737-af2f-93c4094d0371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:34.661141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:34.662906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:34.682358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:34.683381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:34.684394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:34.684394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:34.684394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:34.684394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:34.684394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 368/735] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:34.684697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:34.748571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 368/736] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 12:46:34.749384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee29d19-1bf5-4737-af2f-93c4094d0371 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:34.795361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:34.838502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:34.844534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3ff0-43ab-440b-92cf-3780cca861a7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:34.896252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877517-5281-4070-8cc0-36e592782314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:34.897277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877517-5281-4070-8cc0-36e592782314 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.897830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877517-5281-4070-8cc0-36e592782314 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.898461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877517-5281-4070-8cc0-36e592782314 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:34.899583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11877517-5281-4070-8cc0-36e592782314 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:34.902407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11877517-5281-4070-8cc0-36e592782314 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:34.907436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee29d19-1bf5-4737-af2f-93c4094d0371 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:34.920735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 369/737] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:46:34 2022] POST /identity/v3/services => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:34.921858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877517-5281-4070-8cc0-36e592782314 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:34.995236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:34.996293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:34.996756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:34.997060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.012676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.015342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:35.047452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:35.048497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:35.051277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:35.051277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:35.051277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:35.051277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:35.054988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 369/738] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:35.060756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.100306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877517-5281-4070-8cc0-36e592782314 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.145761 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:35.153813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.154449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.155120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.155730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.156950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:35.156950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.158562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.174097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 370/739] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:35.175059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.215273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c4e7-148f-41d7-87fd-f08a5eb22e85 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.216999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:35.258264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.259451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.260066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.266907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.266907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:35.266907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.266907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.292372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 370/740] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:35.292372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.312486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167f7b6-17d2-471e-850e-9b4924b392ae None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.358778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.359613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.359903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.360185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.360862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.362446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:35.376068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:35.377132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:35.379009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 371/741] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:35.380005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.462203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:35.478147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ce32c-16ff-4c90-9ee9-726ce8b8ebaf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.528241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50219250-1943-44de-86c0-828f694c6aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.528920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219250-1943-44de-86c0-828f694c6aff None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.529397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219250-1943-44de-86c0-828f694c6aff None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.529760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219250-1943-44de-86c0-828f694c6aff None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.530451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50219250-1943-44de-86c0-828f694c6aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:35.530764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50219250-1943-44de-86c0-828f694c6aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.532360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50219250-1943-44de-86c0-828f694c6aff None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.537384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8298f-1818-4981-936e-ba0fdf90ad14 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.550800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 371/742] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:35.550800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50219250-1943-44de-86c0-828f694c6aff None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.579714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:35.586924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.587744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.588034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.588322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.595662 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.597825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:35.613187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:35.614198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:35.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 372/743] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:35.616162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.680069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50219250-1943-44de-86c0-828f694c6aff None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.718565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.719448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.719738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.720149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.729613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.731233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:35.747847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:35.749263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 372/744] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:35.750240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.754495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09c42e-a862-41a8-8179-920f06ab97cc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.778015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:35.805928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.806618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.806914 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.807202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.807977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:35.808295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.809723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.822397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 373/745] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:35.822397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.859056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:35.886080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf23ed6-3582-4cf8-9213-e79ad381c867 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.940629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.941402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.941743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.942034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.950387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.951771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a1879-f070-4b66-99c2-b6a6e122c71f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:35.951887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:35.968102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:35.969330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:46:35.970722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:35.974921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 373/746] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:35.975622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:35.994647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:35.995325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:35.995678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:35.995885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:35.996872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:35.997073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:35.998576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:36.014567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 374/747] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:36.020298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:36.068457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:36.091052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39215d-e50f-4d63-87a0-ca3c4283e49d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:36.148618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:36.149896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:36.150213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:36.150665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:36.151981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:36.152491 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:36.154831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:36.164861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71015348-ca3f-45ba-bf23-fe86cf3f6202 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:36.181108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 374/748] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:36.181108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:36.185800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:36.241880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:36.242593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:36.242922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:36.243275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:36.244086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:36.244467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:36.246011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:36.251892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 375/749] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 8 12:46:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:36.253504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:36.349831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506c9eb-cffc-4ce5-953b-63d0e376129c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:36.404201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ba2bb-c614-4163-a338-55ee0873b2a6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:36.406800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:36.425016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:36.426194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:36.426672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:36.427146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:36.428712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:36.429228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:36.431959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:36.463304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 375/750] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 8 12:46:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:36.464690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:36.478916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:36.479589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:36.479879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:36.480162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:36.481012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=63fe1877e3334a29b3bdfa0ba22174da) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:36.481324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:36.482826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:36.489200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 376/751] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:36 2022] GET /identity/v3/role_assignments?user.id=63fe1877e3334a29b3bdfa0ba22174da&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:36.491867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:36.549448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:36.624208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4117d-b5af-4e44-82c8-2c4dcb2e3cd8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:36.641166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0adba-9ba5-4c9b-a818-081ba7f176ba None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:36.679477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:36.680697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:36.681193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:36.681706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:36.682627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=1706af7489064b9f9087b740249630b2) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:36.682949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:36.684934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:36.700678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:36.701970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:36.702580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:36.703138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:36.704412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] RBAC: Adding query filter params (interface=public, service_id=5e712a4335774daab3993f96a5a2d5d7, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:36.705010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:36.706197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 376/752] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:36 2022] GET /identity/v3/role_assignments?user.id=1706af7489064b9f9087b740249630b2&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:36.707058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:36.707250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:36.718863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 377/753] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 8 12:46:36 2022] GET /identity/v3/endpoints?service_id=5e712a4335774daab3993f96a5a2d5d7&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:36.725681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:36.773063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:36.918219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88164-ae0f-45f0-b54c-7dd0db47fd70 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:36.941402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ce435-8a3f-4408-a24c-c67bf082453c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:36.952237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:36.972417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20339c1-7783-4d26-878c-c8d220d50c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:36.973118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20339c1-7783-4d26-878c-c8d220d50c1b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:36.973407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20339c1-7783-4d26-878c-c8d220d50c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:36.973715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20339c1-7783-4d26-878c-c8d220d50c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:37.012534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df40d4-1adb-4071-aba2-93c12f60054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:37.012534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df40d4-1adb-4071-aba2-93c12f60054e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:37.012534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df40d4-1adb-4071-aba2-93c12f60054e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:37.012534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df40d4-1adb-4071-aba2-93c12f60054e None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:37.013358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df40d4-1adb-4071-aba2-93c12f60054e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:37.014887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df40d4-1adb-4071-aba2-93c12f60054e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:37.021983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 378/754] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:46:36 2022] GET /identity/v3/services => generated 772 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:37.073905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20339c1-7783-4d26-878c-c8d220d50c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:37.075870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20339c1-7783-4d26-878c-c8d220d50c1b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:37.218339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 377/755] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:46:37.223819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df40d4-1adb-4071-aba2-93c12f60054e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:37.371798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:37.380718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df40d4-1adb-4071-aba2-93c12f60054e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:37.448812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff341c0c-0ba7-4ca2-963d-531a137a3c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:37.449808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff341c0c-0ba7-4ca2-963d-531a137a3c57 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:37.450104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff341c0c-0ba7-4ca2-963d-531a137a3c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:37.450395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff341c0c-0ba7-4ca2-963d-531a137a3c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:37.468247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff341c0c-0ba7-4ca2-963d-531a137a3c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:37.469948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff341c0c-0ba7-4ca2-963d-531a137a3c57 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ff341c0c-0ba7-4ca2-963d-531a137a3c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:37.492073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:37.493036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:37.494002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:37.494002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:37.494002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:37.494002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:37.494002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 379/756] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:37.499094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20339c1-7783-4d26-878c-c8d220d50c1b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:37.547248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:37.634828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090a3d-4a7a-46fd-8863-f6ec3b617f73 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:37.635170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090a3d-4a7a-46fd-8863-f6ec3b617f73 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:37.635431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090a3d-4a7a-46fd-8863-f6ec3b617f73 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:37.638063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 380/757] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:37.647102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce57a8-417a-40b5-b4c1-69918b945b69 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:37.647417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce57a8-417a-40b5-b4c1-69918b945b69 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:37.647754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce57a8-417a-40b5-b4c1-69918b945b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:37.668434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20339c1-7783-4d26-878c-c8d220d50c1b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:37.680920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c0ce57a8-417a-40b5-b4c1-69918b945b69 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:37.690726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c0ce57a8-417a-40b5-b4c1-69918b945b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:37.733428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:37.734575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:37.735191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:37.735711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:37.737345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:37.737922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:37.740826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:37.761614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 378/758] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:37.767093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:37.803263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 381/759] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:46:37.840970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce57a8-417a-40b5-b4c1-69918b945b69 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:37.917651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:37.951007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ff1a-1f7d-40e5-a43f-63fa72f8492a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:38.013142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:38.028065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:38.029431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:38.031076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:38.031750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:38.044850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:38.046844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:38.070458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:38.071418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:38.072324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:38.072324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:38.072324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:38.072324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:38.072324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:38.072324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:38.072324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:38.072324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:38.074920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 379/760] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:38.084010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce57a8-417a-40b5-b4c1-69918b945b69 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:38.085306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:38.191883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d428dc-cfae-4b85-aeb9-d4d267c06e55 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:38.228949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595588f7-5061-40be-b327-ff728630abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:38.230047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595588f7-5061-40be-b327-ff728630abab None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:38.230223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:38.230639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595588f7-5061-40be-b327-ff728630abab None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:38.231123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595588f7-5061-40be-b327-ff728630abab None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:38.231240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:38.231499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:38.231779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] PATH_INFO: `/v3/services/network` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:38.232445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:38.232861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595588f7-5061-40be-b327-ff728630abab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:38.233381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595588f7-5061-40be-b327-ff728630abab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:38.233866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:38.235356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595588f7-5061-40be-b327-ff728630abab None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:38.249407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 380/761] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:38.257018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595588f7-5061-40be-b327-ff728630abab None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:38.265975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:38.287493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:38.288545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:38.289381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:38.294039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 382/762] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:37 2022] GET /identity/v3/services/network => generated 88 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:38.298603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:38.497904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595588f7-5061-40be-b327-ff728630abab None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:38.536469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016ad7e-367c-4768-a828-a1714cc57d0e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:38.575356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:38.576317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:38.576760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:38.577194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:38.578220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=256fd73e1b214911b6a2480d89b36090) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:38.578688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:38.580316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:38.587138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:38.587498 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 381/763] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:38 2022] GET /identity/v3/role_assignments?user.id=256fd73e1b214911b6a2480d89b36090&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:38.588181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:38.588629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:38.589086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:38.590013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] RBAC: Adding query filter params (name=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:38.590472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:38.592041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:38.601444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 383/764] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:46:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:38.607242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:38.726667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:38.778791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ad243-6c07-4920-b511-f594ed0c440a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:38.818380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:38.819304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:38.819747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:38.820197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:38.821077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:38.821561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:38.823125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:38.829417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 382/765] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:46:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:38.843426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:38.862830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:38.987715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30858326-192c-48e0-bda9-7268d29d0e03 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:39.024480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b85f9-6610-4c36-9005-b7787c3bbc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:39.025157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b85f9-6610-4c36-9005-b7787c3bbc30 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:39.025450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b85f9-6610-4c36-9005-b7787c3bbc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:39.025766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b85f9-6610-4c36-9005-b7787c3bbc30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:39.026580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b85f9-6610-4c36-9005-b7787c3bbc30 None admin] RBAC: Adding query filter params (interface=public, service_id=3be3dd4d526c41c0b0e05ec64476ccaa, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:39.026899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b85f9-6610-4c36-9005-b7787c3bbc30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:39.028290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b85f9-6610-4c36-9005-b7787c3bbc30 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:39.034824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 384/766] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 8 12:46:38 2022] GET /identity/v3/endpoints?service_id=3be3dd4d526c41c0b0e05ec64476ccaa&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:39.040326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:39.193884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4a70c-54c8-40d0-ac05-7d38e45885b8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:39.233839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:39.245854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89090637-0309-4dbb-a6bd-e271bf0196a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:39.246553 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89090637-0309-4dbb-a6bd-e271bf0196a6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:39.246841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89090637-0309-4dbb-a6bd-e271bf0196a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:39.247129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89090637-0309-4dbb-a6bd-e271bf0196a6 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:39.247821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89090637-0309-4dbb-a6bd-e271bf0196a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:39.249215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89090637-0309-4dbb-a6bd-e271bf0196a6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:39.258953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 383/767] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:46:39 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:39.410413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7820a48-3079-47f1-a810-7f84935036b3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:39.410811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7820a48-3079-47f1-a810-7f84935036b3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:39.411001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7820a48-3079-47f1-a810-7f84935036b3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:39.412819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 385/768] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:39.420826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4098a2-b5ab-42c1-ba88-be7a94197b1f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:39.421462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4098a2-b5ab-42c1-ba88-be7a94197b1f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:39.421975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4098a2-b5ab-42c1-ba88-be7a94197b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:39.450862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1b4098a2-b5ab-42c1-ba88-be7a94197b1f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:39.452405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1b4098a2-b5ab-42c1-ba88-be7a94197b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:39.548916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 384/769] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:39.575451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7820a48-3079-47f1-a810-7f84935036b3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:39.654368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:39.697001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7820a48-3079-47f1-a810-7f84935036b3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:39.739659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d75f-2c1c-4f98-84e0-bf5f35ebce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:39.740836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d75f-2c1c-4f98-84e0-bf5f35ebce78 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:39.741635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d75f-2c1c-4f98-84e0-bf5f35ebce78 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:39.742112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d75f-2c1c-4f98-84e0-bf5f35ebce78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:39.754915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7d75f-2c1c-4f98-84e0-bf5f35ebce78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ccb7d75f-2c1c-4f98-84e0-bf5f35ebce78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:39.763035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:39.764012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:39.764837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:39.767663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 386/770] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:39.777807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4098a2-b5ab-42c1-ba88-be7a94197b1f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:39.811589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644b2d-6eac-48c8-af70-e352d25290b3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:39.811923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644b2d-6eac-48c8-af70-e352d25290b3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:39.812163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644b2d-6eac-48c8-af70-e352d25290b3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:39.815349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 387/771] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:39.819957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c05523-2d07-4b9a-ac41-28e5220e1499 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:39.820266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c05523-2d07-4b9a-ac41-28e5220e1499 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:39.820550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c05523-2d07-4b9a-ac41-28e5220e1499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:39.841762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a4c05523-2d07-4b9a-ac41-28e5220e1499 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:39.843173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a4c05523-2d07-4b9a-ac41-28e5220e1499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:39.921688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 388/772] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:39.946903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c05523-2d07-4b9a-ac41-28e5220e1499 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:39.975409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4098a2-b5ab-42c1-ba88-be7a94197b1f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.029993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:40.032054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:40.044603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:40.045365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.045600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.045873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.046722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:40.047040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:40.048778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:40.070951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 385/773] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:40.078561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:40.117074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c05523-2d07-4b9a-ac41-28e5220e1499 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.179094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e804f4b-e79e-4f51-aef2-601f5c43f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:40.180317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e804f4b-e79e-4f51-aef2-601f5c43f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.180807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e804f4b-e79e-4f51-aef2-601f5c43f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.181281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e804f4b-e79e-4f51-aef2-601f5c43f9f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.193683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e804f4b-e79e-4f51-aef2-601f5c43f9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2e804f4b-e79e-4f51-aef2-601f5c43f9f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:40.202118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:40.203124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:40.203976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:40.208075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 389/774] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:40.209919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8fd4-8700-4d3f-9720-b1759dca3c69 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.210412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8fd4-8700-4d3f-9720-b1759dca3c69 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.210910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8fd4-8700-4d3f-9720-b1759dca3c69 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.217235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 390/775] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:40.218531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf8fd4-8700-4d3f-9720-b1759dca3c69 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:40.228110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a245d-260e-4242-89c0-4feeaf3fef6d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.264233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4c88e-fb8c-4d67-8097-1ddce4b4b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:40.265046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c88e-fb8c-4d67-8097-1ddce4b4b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.265339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c88e-fb8c-4d67-8097-1ddce4b4b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.265650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c88e-fb8c-4d67-8097-1ddce4b4b0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.278100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4c88e-fb8c-4d67-8097-1ddce4b4b0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:40.279592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4c88e-fb8c-4d67-8097-1ddce4b4b0b9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-98b4c88e-fb8c-4d67-8097-1ddce4b4b0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:40.309571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:40.310506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:40.311392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:40.311392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:40.311392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:40.311392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:40.313827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 386/776] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:40.316490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bae1dc-8c01-4bd4-b02a-9fe0113ed02e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.317587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bae1dc-8c01-4bd4-b02a-9fe0113ed02e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.318079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bae1dc-8c01-4bd4-b02a-9fe0113ed02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.342490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a4bae1dc-8c01-4bd4-b02a-9fe0113ed02e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:40.343206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf8fd4-8700-4d3f-9720-b1759dca3c69 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.344213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a4bae1dc-8c01-4bd4-b02a-9fe0113ed02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:40.363410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:40.383880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:40.384702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.385124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.385438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.386503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:40.386678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:40.388316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:40.396962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:40.399258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 391/777] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:40.400209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:40.455253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 387/778] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:40.455253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bae1dc-8c01-4bd4-b02a-9fe0113ed02e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:40.532887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4ff29-f170-4c63-80e9-386999ef6e58 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.574458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:40.575451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.576031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.576969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.578043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:40.578657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:40.580667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:40.595136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 392/779] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:40.597065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:40.606114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bae1dc-8c01-4bd4-b02a-9fe0113ed02e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.646788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:40.659363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:40.660325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.660614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.660997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.678613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:40.680566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:40.712830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:40.714582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:40.717188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:40.717188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:40.717188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:40.717188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:40.717188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 388/780] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:40.717188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:40.738399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b685d-d6bd-40c8-818c-1e3b90bc87d1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.754960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:40.793424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:40.794332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.794624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.795098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.797328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:40.800983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:40.816967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:40.818115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 12:46:40.819154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:40.821622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 393/781] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Jun 8 12:46:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:40.822745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:40.863957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a641b1e-ae97-4eb1-abb9-38dfde79770d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.912046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:40.912863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:40.913154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:40.913437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:40.922163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:40.924776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:40.948244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63e18-df89-4c2f-ac82-006945c1dce5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:40.950069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:40.951021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:40.951973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:40.954645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 389/782] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:46:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:40.955909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:40.957215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:40.998777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.001929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.002731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.003826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.005975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:41.007094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.011246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.028604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 394/783] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:41.029330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.078244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:41.102467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84e881-2aa8-40f3-bd20-a101c427d11c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.145247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.146736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.147190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.148167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:41.148641 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.150239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.150804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2223-eff5-4adc-b6d3-cad05493343f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.156131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 390/784] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 8 12:46:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:41.157317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.192144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.192931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.193318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.193692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.194718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:41.195100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.196777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.223908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 395/785] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:46:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:41.225175 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.252903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:41.276186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459769ec-6626-4727-a4f2-127702d16934 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.316003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.317232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.317791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.318289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.326961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.328745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.340674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601754-00b0-4ec5-aabd-e1707d759490 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:41.349361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:41.350385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:41.351340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:41.354182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 391/786] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:41.355259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.371680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:41.384799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.385800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.386235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.386769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.387651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:41.388212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.389926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.397505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 396/787] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 8 12:46:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:41.398694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.492548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709490b-614b-42b4-818f-52530cdb9b45 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.505410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:41.523809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1d390-fd2b-49f3-b681-e6fb7d35fc67 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.532749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.533825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.534149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.534595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.545801 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.547731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.562836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab408d-3477-4225-87d6-29e19209b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.563519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab408d-3477-4225-87d6-29e19209b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.563811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab408d-3477-4225-87d6-29e19209b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.564195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab408d-3477-4225-87d6-29e19209b8d3 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.565395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab408d-3477-4225-87d6-29e19209b8d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:41.565753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab408d-3477-4225-87d6-29e19209b8d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.567230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab408d-3477-4225-87d6-29e19209b8d3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:41.570855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:41.571741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:41.572882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:41.572882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:41.572882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:41.572882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:41.576821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 392/788] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:41.577995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.589152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 397/789] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 8 12:46:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:41.591126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e920d-aa35-451d-8f1b-a68c8c94a164 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.591624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e920d-aa35-451d-8f1b-a68c8c94a164 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.592179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e920d-aa35-451d-8f1b-a68c8c94a164 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.593981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 398/790] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:41.594914 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e920d-aa35-451d-8f1b-a68c8c94a164 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.655342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:41.705897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65e7a4-e4b1-4ad0-bff4-52543c30af9c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.736677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e920d-aa35-451d-8f1b-a68c8c94a164 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.758918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c5b7-1324-4c5c-a88c-c6632b8d83a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.759920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c5b7-1324-4c5c-a88c-c6632b8d83a3 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.760347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c5b7-1324-4c5c-a88c-c6632b8d83a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.760784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c5b7-1324-4c5c-a88c-c6632b8d83a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.761777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90c5b7-1324-4c5c-a88c-c6632b8d83a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.763526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90c5b7-1324-4c5c-a88c-c6632b8d83a3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.793974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 393/791] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:46:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:41.793974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c5b7-1324-4c5c-a88c-c6632b8d83a3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.817955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f370c9-8075-4e08-b7ea-bfe48f3ea797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.818772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f370c9-8075-4e08-b7ea-bfe48f3ea797 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.819226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f370c9-8075-4e08-b7ea-bfe48f3ea797 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.819575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f370c9-8075-4e08-b7ea-bfe48f3ea797 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.820561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f370c9-8075-4e08-b7ea-bfe48f3ea797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:41.820988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f370c9-8075-4e08-b7ea-bfe48f3ea797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:41.822587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f370c9-8075-4e08-b7ea-bfe48f3ea797 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:41.839632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 399/792] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:41.841153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4604f9-33f9-4abe-911b-849cc0608fe2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.841455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4604f9-33f9-4abe-911b-849cc0608fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.841768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4604f9-33f9-4abe-911b-849cc0608fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:41.843507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:41.863580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bd4604f9-33f9-4abe-911b-849cc0608fe2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:41.864892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bd4604f9-33f9-4abe-911b-849cc0608fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:41.944554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c5b7-1324-4c5c-a88c-c6632b8d83a3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:41.958059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 400/793] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:41.959129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4604f9-33f9-4abe-911b-849cc0608fe2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:41.961931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:41.996759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:41.997610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:41.997900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:41.998181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.014410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:42.016205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:42.043098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:42.044048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:42.044972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:42.044972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:42.044972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:42.044972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:42.049650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 394/794] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:42.049650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:42.098076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4604f9-33f9-4abe-911b-849cc0608fe2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.138852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:42.148667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:42.149637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.150134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.150625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.162838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:42.164571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:42.185070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d538a-0df3-4ebc-ac23-8166c70c2947 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:42.186443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:42.187510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:42.188419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:42.188419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:42.188419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:42.188419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:42.188419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:42.188419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:42.188419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:42.188419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:42.188854 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 401/795] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:42.189431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:42.229995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256678f-9cd1-4ffd-81ca-f1d148220033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:42.230749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256678f-9cd1-4ffd-81ca-f1d148220033 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.231041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256678f-9cd1-4ffd-81ca-f1d148220033 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.231391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256678f-9cd1-4ffd-81ca-f1d148220033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.244345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256678f-9cd1-4ffd-81ca-f1d148220033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9256678f-9cd1-4ffd-81ca-f1d148220033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:42.256941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:42.258765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:42.259796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:42.261862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 395/796] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:42.263433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256678f-9cd1-4ffd-81ca-f1d148220033 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:42.297716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:42.373017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bebaed-7438-4cae-bfcc-40d84dbb2259 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.380891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256678f-9cd1-4ffd-81ca-f1d148220033 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.426914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:42.427970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.427970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.428133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.428939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:42.429254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:42.430738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:42.435746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:42.436735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.437275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.437794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.438778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:42.439375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:42.441071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:42.449603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 396/797] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:42.449603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:42.470186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 402/798] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:42.474082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:42.538379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:42.542692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:42.560346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7231-cecd-46c0-8062-02c7fe005bc3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.599188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:42.599874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.600161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.600447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.601200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:42.601510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:42.602925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:42.608277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45991b-0bf5-44cb-93ca-7dfb88c84bdd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.612564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 397/799] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:42.613967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:42.651890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8e828-6be2-476a-beca-9069b5a0a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:42.653168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e828-6be2-476a-beca-9069b5a0a433 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.653715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e828-6be2-476a-beca-9069b5a0a433 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.654201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e828-6be2-476a-beca-9069b5a0a433 None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/63fe1877e3334a29b3bdfa0ba22174da/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.656593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e828-6be2-476a-beca-9069b5a0a433 None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=63fe1877e3334a29b3bdfa0ba22174da, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:42.658347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e828-6be2-476a-beca-9069b5a0a433 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:42.680768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 403/800] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:46:42 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/63fe1877e3334a29b3bdfa0ba22174da/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:46:42.682286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8e828-6be2-476a-beca-9069b5a0a433 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:42.728759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089e0b9-1aef-4280-8ac5-d02baed39f23 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.773867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1593b-0e81-4834-9436-66ff6c2d70f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:42.774695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1593b-0e81-4834-9436-66ff6c2d70f8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.774999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1593b-0e81-4834-9436-66ff6c2d70f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.775289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1593b-0e81-4834-9436-66ff6c2d70f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.783800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1593b-0e81-4834-9436-66ff6c2d70f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:42.786056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1593b-0e81-4834-9436-66ff6c2d70f8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-76a1593b-0e81-4834-9436-66ff6c2d70f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:42.803208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:42.810398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 398/801] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad857f-d1aa-414c-a14e-f16f2ec41d33 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.811974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad857f-d1aa-414c-a14e-f16f2ec41d33 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.813026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad857f-d1aa-414c-a14e-f16f2ec41d33 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.813026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 399/802] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:42.819114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad857f-d1aa-414c-a14e-f16f2ec41d33 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:42.836012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:42.875771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8e828-6be2-476a-beca-9069b5a0a433 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.890891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:42.923431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41356a-5c9e-4c2d-9c2f-76cbce6e96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:42.924771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41356a-5c9e-4c2d-9c2f-76cbce6e96c7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.925934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41356a-5c9e-4c2d-9c2f-76cbce6e96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.926157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41356a-5c9e-4c2d-9c2f-76cbce6e96c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.937290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41356a-5c9e-4c2d-9c2f-76cbce6e96c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:42.938818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41356a-5c9e-4c2d-9c2f-76cbce6e96c7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:42.957714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad857f-d1aa-414c-a14e-f16f2ec41d33 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-dd41356a-5c9e-4c2d-9c2f-76cbce6e96c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:42.962811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:42.964492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:42.966657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:42.966657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:42.966657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:42.966657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:42.966657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 404/803] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:42.966657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bb2f-991e-4733-9a5b-86990617da08 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:42.966657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bb2f-991e-4733-9a5b-86990617da08 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:42.966657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bb2f-991e-4733-9a5b-86990617da08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:42.989874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7538bb2f-991e-4733-9a5b-86990617da08 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:42.989874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7538bb2f-991e-4733-9a5b-86990617da08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:43.012033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:43.012766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:43.013060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:43.013347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:43.014504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:43.014831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:43.016306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:43.033350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 400/804] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:43.034984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:43.100050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 405/805] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:43.101730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538bb2f-991e-4733-9a5b-86990617da08 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:43.120755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:43.165390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3b912-2124-44a1-b7ac-1301c40572d0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:43.220922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:43.221748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:43.222701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:43.223005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:43.223802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:43.224126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:43.225921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:43.240932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 401/806] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:43.242093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:43.250058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538bb2f-991e-4733-9a5b-86990617da08 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:43.254113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:43.289485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842433c5-9ed9-451b-aeb9-89c013dbaef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:43.290440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842433c5-9ed9-451b-aeb9-89c013dbaef9 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:43.290725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842433c5-9ed9-451b-aeb9-89c013dbaef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:43.291003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842433c5-9ed9-451b-aeb9-89c013dbaef9 None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/1706af7489064b9f9087b740249630b2/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:43.293057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842433c5-9ed9-451b-aeb9-89c013dbaef9 None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=1706af7489064b9f9087b740249630b2, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:43.294546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842433c5-9ed9-451b-aeb9-89c013dbaef9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:43.311402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 406/807] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:46:43 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/1706af7489064b9f9087b740249630b2/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:46:43.312321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842433c5-9ed9-451b-aeb9-89c013dbaef9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:43.387987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da13495-6118-4c95-8d9b-dd4389fa36b5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:43.458266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:43.474356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:43.475205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:43.475499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:43.475855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] PATH_INFO: `/v3/services/network` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:43.476699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:43.478187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:43.491707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842433c5-9ed9-451b-aeb9-89c013dbaef9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:43.494625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:43.495650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 12:46:43.496497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:43.497830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 402/808] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:43 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:43.506695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:43.594249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:43.595670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:43.596767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:43.597057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:43.606049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:43.608009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:43.635668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:43.637923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:43.639194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 407/809] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:46:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:43.647758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:43.651824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534f87-fe24-4c49-9c76-62fdc39c973c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:43.669019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:43.719883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:43.721019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:43.721486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:43.722038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:43.723228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] RBAC: Adding query filter params (name=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:43.723719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:43.726077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:43.738602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 403/810] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:46:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:43.745494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:43.833403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65006194-ca6f-4999-8918-cdfbf340c684 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:43.852625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:43.871936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:43.873048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:43.873566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:43.874114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:43.875167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:43.875736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:43.878117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:43.904468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 408/811] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 8 12:46:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:43.911062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:43.928755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179ab08-4e0d-4263-8288-f09f846a4509 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:44.030325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:44.031054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:44.031382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:44.031637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:44.032372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:44.032709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:44.034260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:44.041354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 404/812] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:46:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:44.046116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:44.052068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:44.125404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005545-ddb7-461c-8c18-c744553267f0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:44.216569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:44.217391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:44.217730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:44.218018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:44.241538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:44.243126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:44.272261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:44.273213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:44.274132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:44.274132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:44.274132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:44.274132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:44.276845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 409/813] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:44.283106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:44.304249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb02c3-65b4-4675-82a5-71f2bdf24cd7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:44.350900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:44.386385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618255bd-1729-45c3-974d-fecb27f129e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:44.387445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618255bd-1729-45c3-974d-fecb27f129e9 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:44.387946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618255bd-1729-45c3-974d-fecb27f129e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:44.388429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618255bd-1729-45c3-974d-fecb27f129e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:44.394945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618255bd-1729-45c3-974d-fecb27f129e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:44.396648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618255bd-1729-45c3-974d-fecb27f129e9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:44.431638 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 405/814] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:46:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:44.515742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef519f45-b8b5-4638-9bdd-77982da15d3d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:44.556137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:44.576842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e32634-0706-4278-b8e8-7276274186ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:44.577524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32634-0706-4278-b8e8-7276274186ae None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:44.577841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32634-0706-4278-b8e8-7276274186ae None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:44.578126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32634-0706-4278-b8e8-7276274186ae None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:44.578894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e32634-0706-4278-b8e8-7276274186ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:44.579206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e32634-0706-4278-b8e8-7276274186ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:44.581387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e32634-0706-4278-b8e8-7276274186ae None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:44.596702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 410/815] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:44.602709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618255bd-1729-45c3-974d-fecb27f129e9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:44.788390 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c86a-8222-4a3e-9619-aa1f1ddc5b27 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:44.788906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c86a-8222-4a3e-9619-aa1f1ddc5b27 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:44.789246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c86a-8222-4a3e-9619-aa1f1ddc5b27 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:44.789739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618255bd-1729-45c3-974d-fecb27f129e9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:44.791898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 411/816] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:44.798923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac90b0-bf06-429c-910e-092e98c0de2c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:44.799882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac90b0-bf06-429c-910e-092e98c0de2c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:44.800264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac90b0-bf06-429c-910e-092e98c0de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:44.823678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8dac90b0-bf06-429c-910e-092e98c0de2c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:44.825263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8dac90b0-bf06-429c-910e-092e98c0de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:44.840328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:44.841144 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:44.841436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:44.841776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:44.854050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:44.856286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:44.890805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:44.892584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:44.894307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 406/817] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:44.899503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:44.950037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:44.952887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 412/818] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:44.981530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac90b0-bf06-429c-910e-092e98c0de2c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:45.016416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e460d8-aee4-4a2f-a6fc-d178b01cca25 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:45.055721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:45.056232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:45.056707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:45.057217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:45.059099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:45.059686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:45.062639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:45.079132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 407/819] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:45.085335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:45.104310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac90b0-bf06-429c-910e-092e98c0de2c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:45.115495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:45.143433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:45.144427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:45.144815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:45.145196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:45.146003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:45.147491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:45.161062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:45.162248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:45.163072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:45.163828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 413/820] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:45.168962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:45.201900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba297798-3b7b-4acc-8b1d-2090bc934d97 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:45.206373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:45.252528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c065-530b-478a-b778-b489104d1434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:45.253760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c065-530b-478a-b778-b489104d1434 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:45.254120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c065-530b-478a-b778-b489104d1434 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:45.254476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c065-530b-478a-b778-b489104d1434 None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/256fd73e1b214911b6a2480d89b36090/roles/ea6c0a1f7c484564aacab2eb0e62eef9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:45.273981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c065-530b-478a-b778-b489104d1434 None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=256fd73e1b214911b6a2480d89b36090, role_id=ea6c0a1f7c484564aacab2eb0e62eef9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:45.275835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c065-530b-478a-b778-b489104d1434 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:45.298884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 408/821] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:46:45 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/256fd73e1b214911b6a2480d89b36090/roles/ea6c0a1f7c484564aacab2eb0e62eef9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:46:45.308108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6e91-f342-48eb-8456-d1e79880a9cc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:45.354407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b98c62-f7da-40b6-b4bd-ce807193a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:45.355372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98c62-f7da-40b6-b4bd-ce807193a6cf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:45.355845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98c62-f7da-40b6-b4bd-ce807193a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:45.356274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98c62-f7da-40b6-b4bd-ce807193a6cf None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:45.357248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b98c62-f7da-40b6-b4bd-ce807193a6cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:45.358081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b98c62-f7da-40b6-b4bd-ce807193a6cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:45.359732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b98c62-f7da-40b6-b4bd-ce807193a6cf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:45.368421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 414/822] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:45.374453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c065-530b-478a-b778-b489104d1434 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:45.517607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c065-530b-478a-b778-b489104d1434 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:45.558219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc661c-6966-4b7e-9325-1783fa3acbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:45.558838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc661c-6966-4b7e-9325-1783fa3acbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:45.559129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc661c-6966-4b7e-9325-1783fa3acbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:45.559465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc661c-6966-4b7e-9325-1783fa3acbf4 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:45.560143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc661c-6966-4b7e-9325-1783fa3acbf4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:45.560451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc661c-6966-4b7e-9325-1783fa3acbf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:45.562459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc661c-6966-4b7e-9325-1783fa3acbf4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:45.568623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 409/823] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:45.586742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363cef5-fd80-462c-a6bc-0d5b503b37e4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:45.587066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363cef5-fd80-462c-a6bc-0d5b503b37e4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:45.587322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363cef5-fd80-462c-a6bc-0d5b503b37e4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:45.591330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 415/824] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:45.596748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05647b1-a0da-4985-89ea-c03a4f45651a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:45.597097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05647b1-a0da-4985-89ea-c03a4f45651a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:45.597326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05647b1-a0da-4985-89ea-c03a4f45651a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:45.615752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c05647b1-a0da-4985-89ea-c03a4f45651a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:45.617257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c05647b1-a0da-4985-89ea-c03a4f45651a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:45.621688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:45.709374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 410/825] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:45.737413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363cef5-fd80-462c-a6bc-0d5b503b37e4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:45.782408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:45.865507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363cef5-fd80-462c-a6bc-0d5b503b37e4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:45.902238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c86089-6206-4595-8544-b236cc22f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:45.903054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86089-6206-4595-8544-b236cc22f59e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:45.903341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86089-6206-4595-8544-b236cc22f59e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:45.903624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86089-6206-4595-8544-b236cc22f59e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:45.916272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c86089-6206-4595-8544-b236cc22f59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b0c86089-6206-4595-8544-b236cc22f59e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:45.924221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:45.925463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:45.926342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:45.929664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 416/826] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:45.931856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05647b1-a0da-4985-89ea-c03a4f45651a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.044658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05647b1-a0da-4985-89ea-c03a4f45651a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:46.084891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d58bf-3827-4834-9c70-61e9ff74dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:46.085600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d58bf-3827-4834-9c70-61e9ff74dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.086099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d58bf-3827-4834-9c70-61e9ff74dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.086574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d58bf-3827-4834-9c70-61e9ff74dc05 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.087514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d58bf-3827-4834-9c70-61e9ff74dc05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:46.087827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d58bf-3827-4834-9c70-61e9ff74dc05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:46.089245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d58bf-3827-4834-9c70-61e9ff74dc05 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:46.099505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 411/827] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:46.104859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c86089-6206-4595-8544-b236cc22f59e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.143675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3e2cc-1494-4db2-b7d5-ebb7c4f438fc None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.143964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3e2cc-1494-4db2-b7d5-ebb7c4f438fc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.144178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3e2cc-1494-4db2-b7d5-ebb7c4f438fc None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.145939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 412/828] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:46:46.153767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ebac-6bd8-4b5c-b79f-669facd02f1c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.154099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ebac-6bd8-4b5c-b79f-669facd02f1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.154334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ebac-6bd8-4b5c-b79f-669facd02f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.160089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:46.175896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3ea6ebac-6bd8-4b5c-b79f-669facd02f1c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:46.177243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3ea6ebac-6bd8-4b5c-b79f-669facd02f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:46.226226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:46.235489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c86089-6206-4595-8544-b236cc22f59e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:46.270874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 413/829] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:46.282757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:46.284038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.284713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.285143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.296812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:46.298592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:46.310989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6ebac-6bd8-4b5c-b79f-669facd02f1c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:46.324173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:46.325155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:46.326080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:46.326080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:46.326080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:46.326080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:46.326080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 417/830] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:46.331384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.469213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6ebac-6bd8-4b5c-b79f-669facd02f1c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:46.506101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:46.508010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954148b-898c-4d4d-adf1-9533fe4efdda None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:46.511665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5208d-fcee-4278-80ad-6b967cce900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:46.512819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5208d-fcee-4278-80ad-6b967cce900a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.513374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5208d-fcee-4278-80ad-6b967cce900a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.513948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5208d-fcee-4278-80ad-6b967cce900a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.527947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5208d-fcee-4278-80ad-6b967cce900a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8ab5208d-fcee-4278-80ad-6b967cce900a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:46.537348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:46.538400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:46:46.539253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:46.542625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 414/831] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:46.548580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5208d-fcee-4278-80ad-6b967cce900a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.558363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:46.559120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.559411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.559801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.560560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:46.560874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:46.562317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:46.576748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 418/832] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:46.583254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.599675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:46.686808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5208d-fcee-4278-80ad-6b967cce900a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:46.709088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e96a9c-ece4-43a6-98db-fd7d770f10e4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:46.725970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:46.726810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.727275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.727631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.728568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:46.728952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:46.730560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:46.746391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 415/833] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:46.747597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.749988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:46.750997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.751458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.751906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.761352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:46.763171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:46.779247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:46.780235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:46:46.781167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:46.784103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 419/834] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:46.792369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.812526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:46.866430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:46.869275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ec48-ffc8-4395-a116-db443908fc1a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:46.902712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5011-0850-467d-ae85-89d38de763ed None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:46.909456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:46.910499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.910967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.911450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.923804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:46.926577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:46.941463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:46.942212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:46.942511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:46.942802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:46.943669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:46.943989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:46.945612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:46.948959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:46.950035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:46.951056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:46.951056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:46.951056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:46.951056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:46.958115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 416/835] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:46.959384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:46.971327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 420/836] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:46.972771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:47.082848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd78ee-aeba-4399-90bd-f37e01fa19af None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:47.091272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:47.094153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebce0b-08a1-4c5e-a14d-dd483abb8f96 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:47.122467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:47.123448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.123884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.124331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.124976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:47.126440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:47.127700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:47.130554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:47.135478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452829b9-626f-4ff8-bb31-c5f40d28e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:47.136149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452829b9-626f-4ff8-bb31-c5f40d28e402 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.136441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452829b9-626f-4ff8-bb31-c5f40d28e402 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.136730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452829b9-626f-4ff8-bb31-c5f40d28e402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.151555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 417/837] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:47.152713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:47.214340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452829b9-626f-4ff8-bb31-c5f40d28e402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:47.215657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452829b9-626f-4ff8-bb31-c5f40d28e402 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:47.274296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111a5b2-e2a0-4486-b425-c337a13821cc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:47.318952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:47.320087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.320551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.320976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.330736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:47.332447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:47.337693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 421/838] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:46:47.339236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452829b9-626f-4ff8-bb31-c5f40d28e402 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:47.349959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:47.351155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 12:46:47.352271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:47.359014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 418/839] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:46:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:47.360245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:47.373385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:47.397333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:47.494657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452829b9-626f-4ff8-bb31-c5f40d28e402 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:47.504032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cb4e1-ac44-404a-b55a-9c7098bc386d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:47.536039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:47.537256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.537736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.538218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.543080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:47.543772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.544057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.544337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.545181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:47.545493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:47.547086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:47.553520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:47.556316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:47.575013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 419/840] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 8 12:46:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:47.575939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:47.582676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:47.583759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:47.584962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:47.584962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:47.584962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:47.584962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:47.591272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 422/841] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:47.592791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:47.704574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:47.707138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:47.725757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3246ea-6e93-48f8-8e57-96b0a0efe920 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:47.742417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f443066-b21d-479d-959c-bbd3662737dc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:47.775682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f17fa1-0733-4bdf-b6a2-11f212f8ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:47.776542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f17fa1-0733-4bdf-b6a2-11f212f8ea87 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.776906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f17fa1-0733-4bdf-b6a2-11f212f8ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.777221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f17fa1-0733-4bdf-b6a2-11f212f8ea87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.785145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb19377-b030-4d9c-92f3-f9ea23ef3927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:47.786190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb19377-b030-4d9c-92f3-f9ea23ef3927 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.786836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb19377-b030-4d9c-92f3-f9ea23ef3927 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.787453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb19377-b030-4d9c-92f3-f9ea23ef3927 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.788432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb19377-b030-4d9c-92f3-f9ea23ef3927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:47.788920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb19377-b030-4d9c-92f3-f9ea23ef3927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:47.790611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb19377-b030-4d9c-92f3-f9ea23ef3927 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:47.804340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 423/842] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:47.806206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef6d44-337e-4233-9b67-658bd8d45e6b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.806708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef6d44-337e-4233-9b67-658bd8d45e6b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.807162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef6d44-337e-4233-9b67-658bd8d45e6b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.809049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 424/843] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:47.811378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef6d44-337e-4233-9b67-658bd8d45e6b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:47.862833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f17fa1-0733-4bdf-b6a2-11f212f8ea87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:47.864552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f17fa1-0733-4bdf-b6a2-11f212f8ea87 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:47.934841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef6d44-337e-4233-9b67-658bd8d45e6b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:47.964860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:47.969472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:47.970318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.970606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.971448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.978468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:47.979915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:47.981787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:47.990495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 420/844] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:46:47.990495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01c4a-ed7a-49ee-885f-e0078a600707 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:47.990495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01c4a-ed7a-49ee-885f-e0078a600707 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:47.990495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01c4a-ed7a-49ee-885f-e0078a600707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:47.997081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:47.998086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:47.998968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 425/845] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:47.999700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.006887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b4f01c4a-ed7a-49ee-885f-e0078a600707 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:48.008154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b4f01c4a-ed7a-49ee-885f-e0078a600707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:48.077436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 421/846] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:48.078811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c82a0-9cdf-462b-a7fe-b5616f405426 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.079109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c82a0-9cdf-462b-a7fe-b5616f405426 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.079393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c82a0-9cdf-462b-a7fe-b5616f405426 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.080881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 422/847] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:48.082168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c82a0-9cdf-462b-a7fe-b5616f405426 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.107852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea03c-c847-45fe-821d-7ede45356e1a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:48.142847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e59225-6204-4019-a406-3855260f7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:48.143687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59225-6204-4019-a406-3855260f7f2b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.143981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59225-6204-4019-a406-3855260f7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.144261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59225-6204-4019-a406-3855260f7f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.159803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e59225-6204-4019-a406-3855260f7f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:48.162533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e59225-6204-4019-a406-3855260f7f2b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-78e59225-6204-4019-a406-3855260f7f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:48.184909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:48.186051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:48.186932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:48.186932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:48.186932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:48.186932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:48.186932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 426/848] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:48.187528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37c2df-72b3-45be-bffb-b01ced0756e9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.187817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37c2df-72b3-45be-bffb-b01ced0756e9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.188097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37c2df-72b3-45be-bffb-b01ced0756e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.205856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-da37c2df-72b3-45be-bffb-b01ced0756e9 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:48.207146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-da37c2df-72b3-45be-bffb-b01ced0756e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:48.210415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c82a0-9cdf-462b-a7fe-b5616f405426 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:48.226297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:48.247734 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:48.248406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.248700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.248986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.249828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:48.250155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:48.251636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:48.258524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:48.264821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 423/849] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:48.265713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.289127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 427/850] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:48.290020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37c2df-72b3-45be-bffb-b01ced0756e9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.383396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1645b-b07b-49bb-906a-1674ca0db444 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:48.401984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37c2df-72b3-45be-bffb-b01ced0756e9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:48.421391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6e2d3-8878-424e-9776-e35bd8bdbc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:48.422228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6e2d3-8878-424e-9776-e35bd8bdbc95 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.422522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6e2d3-8878-424e-9776-e35bd8bdbc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.422808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6e2d3-8878-424e-9776-e35bd8bdbc95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.434545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6e2d3-8878-424e-9776-e35bd8bdbc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:48.439334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:48.440666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.440957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.441244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.442020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:48.442336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6fe6e2d3-8878-424e-9776-e35bd8bdbc95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:48.443183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:48.444232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:46:48.451344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:48.452008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:48.452083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 424/851] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:46:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:48.452083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6e2d3-8878-424e-9776-e35bd8bdbc95 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.462406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 428/852] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:48.463239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.482990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:48.508956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:48.559049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6e2d3-8878-424e-9776-e35bd8bdbc95 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:48.570976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d65e4-3111-48dc-a1e0-d11113794a86 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:48.596512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:48.597497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.597815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.598096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.598946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=63fe1877e3334a29b3bdfa0ba22174da) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:48.599259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:48.600712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:48.606991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 425/853] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:48 2022] GET /identity/v3/role_assignments?user.id=63fe1877e3334a29b3bdfa0ba22174da&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:48.607784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.618690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ceb2b-8451-40cc-b679-4c9cb80956fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:48.619404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ceb2b-8451-40cc-b679-4c9cb80956fd None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.619698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ceb2b-8451-40cc-b679-4c9cb80956fd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.619986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ceb2b-8451-40cc-b679-4c9cb80956fd None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.620751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ceb2b-8451-40cc-b679-4c9cb80956fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:48.622300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ceb2b-8451-40cc-b679-4c9cb80956fd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:48.642288 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 429/854] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:46:48 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:48.643187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ceb2b-8451-40cc-b679-4c9cb80956fd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.763441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:48.770750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafa9cd-fef3-4c91-9063-f5b9bfb034ae None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:48.807053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:48.822714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ceb2b-8451-40cc-b679-4c9cb80956fd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:48.825482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:48.826553 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.827116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.827698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.828788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:48.829340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:48.831595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:48.842261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 426/855] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:46:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:48.849793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:48.873767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:48.874604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:48.874893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:48.875175 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:48.889280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:48.890794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:48.909727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:48.910709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:48.913450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 430/856] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:48.917633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:49.030540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09032-6ce7-4245-b956-042199887939 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:49.059016 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1816a28-b552-4979-8eb2-9cdf077c50cf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:49.086645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:49.087750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:49.088040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:49.088319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:49.104358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:49.105095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:49.105989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:49.106958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:49.107969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:49.108714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:49.110336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:49.111113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:49.114400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:49.129114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:49.130991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:49.132933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:49.132933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:49.132933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:49.132933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:49.133461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 427/857] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:49.138667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:49.141712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 431/858] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:49.151132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:49.163510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:49.185409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:49.305384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d824c56-0ec3-4329-96f1-30377dea8971 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:49.312407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677567e-b8b5-4a0b-a78f-ef1779816808 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:49.359899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:49.361585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:49.362765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:49.363294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:49.364395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=1706af7489064b9f9087b740249630b2) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:49.365234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:49.367799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:49.375425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:49.376766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 432/859] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:49 2022] GET /identity/v3/role_assignments?user.id=1706af7489064b9f9087b740249630b2&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:49.377744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:49.378592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:49.379185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:49.380168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:49.380710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:49.382412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:49.399432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 428/860] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:49.415055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:49.518799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:49.543528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ed61-985e-43fe-b4bb-00de09c06b63 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:49.585066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:49.585988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:49.586275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:49.586615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:49.595417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:49.598016 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:49.614979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:49.615980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:49.617676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 433/861] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:46:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:49.624431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:49.708810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:49.740807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c139-73ba-4b65-a35c-8354cad52616 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:49.778218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:49.778902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:49.779234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:49.779520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:49.780377 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:49.780689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:49.782174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:49.807493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 429/862] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 8 12:46:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:49.808928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:49.935594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad6640-fd83-4dc3-a54c-b0ae2e2a1345 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:49.974757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc932c-1524-403a-9b8b-ba43017b7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:49.975363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc932c-1524-403a-9b8b-ba43017b7502 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:49.975656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc932c-1524-403a-9b8b-ba43017b7502 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:49.975940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc932c-1524-403a-9b8b-ba43017b7502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:49.990052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:50.060388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc932c-1524-403a-9b8b-ba43017b7502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:50.062131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc932c-1524-403a-9b8b-ba43017b7502 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:50.197665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 434/863] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:49 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:46:50.199605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:50.330882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a4f0b-67c6-449f-8a0e-394b04e82a97 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:50.363644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:50.371073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:50.371947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:50.372800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:50.373084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:50.386319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:50.387795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:50.421624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:50.422577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:50.423492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:50.423492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:50.423492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:50.423492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:50.424778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 430/864] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:50.435208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc932c-1524-403a-9b8b-ba43017b7502 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:50.488626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:50.568635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc932c-1524-403a-9b8b-ba43017b7502 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:50.607027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:50.608057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:50.608577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:50.609058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:50.610188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:50.610730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:50.612957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:50.627277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 435/865] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:50.633900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:50.796042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f440062-26b7-4d2e-a1b6-55d6d8178887 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:50.837104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:50.837993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:50.838283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:50.838570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:50.847984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:50.849624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:50.865780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:50.866984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:50.867885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 431/866] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:50.875004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:51.013531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:51.017296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10a83-57f0-414f-9427-fa0bc6d4f38d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:51.073323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e7849-74b3-4ac4-a9f1-f0d8b85f8dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:51.074168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e7849-74b3-4ac4-a9f1-f0d8b85f8dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.074354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e7849-74b3-4ac4-a9f1-f0d8b85f8dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.074637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e7849-74b3-4ac4-a9f1-f0d8b85f8dc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.075490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e7849-74b3-4ac4-a9f1-f0d8b85f8dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:51.075806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e7849-74b3-4ac4-a9f1-f0d8b85f8dc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:51.077320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e7849-74b3-4ac4-a9f1-f0d8b85f8dc6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:51.098437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 436/867] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:51.104543 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:51.158846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:51.238480 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eead59-c464-4b61-a897-2fd529b05ca6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:51.287365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16581-9cf2-417d-b289-50a727286b1a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.287696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16581-9cf2-417d-b289-50a727286b1a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.287938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16581-9cf2-417d-b289-50a727286b1a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.289594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 437/868] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:51.291615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45129f45-cc64-4938-be07-9ff75e4276e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:51.292294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129f45-cc64-4938-be07-9ff75e4276e9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.292582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129f45-cc64-4938-be07-9ff75e4276e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.292865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45129f45-cc64-4938-be07-9ff75e4276e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.293925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45129f45-cc64-4938-be07-9ff75e4276e9 None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=256fd73e1b214911b6a2480d89b36090) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:51.294249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45129f45-cc64-4938-be07-9ff75e4276e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:51.295081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2823b-b18b-46c3-9ba4-72d67e57f843 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.295377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2823b-b18b-46c3-9ba4-72d67e57f843 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.295664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2823b-b18b-46c3-9ba4-72d67e57f843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.295767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45129f45-cc64-4938-be07-9ff75e4276e9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:51.304789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 432/869] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:51 2022] GET /identity/v3/role_assignments?user.id=256fd73e1b214911b6a2480d89b36090&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:51.315250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-abd2823b-b18b-46c3-9ba4-72d67e57f843 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:51.316698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-abd2823b-b18b-46c3-9ba4-72d67e57f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:51.466086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 438/870] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:46:51.478291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9e41-f574-4eeb-b4a8-52487ae3299f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.478608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9e41-f574-4eeb-b4a8-52487ae3299f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.478868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9e41-f574-4eeb-b4a8-52487ae3299f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.483725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 433/871] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:51.487593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab8155-609a-47e7-883a-cb553146627f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.487960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab8155-609a-47e7-883a-cb553146627f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.488261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab8155-609a-47e7-883a-cb553146627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.505927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9e41-f574-4eeb-b4a8-52487ae3299f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:51.513029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3aab8155-609a-47e7-883a-cb553146627f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:51.515219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3aab8155-609a-47e7-883a-cb553146627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:51.609792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 439/872] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:51.633215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab8155-609a-47e7-883a-cb553146627f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:51.656559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9e41-f574-4eeb-b4a8-52487ae3299f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:51.664703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:51.667497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:51.714963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:51.716454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.716749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.717028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.717888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:51.719888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:51.735366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:51.736730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:51.738207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 434/873] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:51.744682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:51.774412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab8155-609a-47e7-883a-cb553146627f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:51.821786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:51.823184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.823768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.824267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.825185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:51.826896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:51.841051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:51.842406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:46:51.843258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:51.846957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 440/874] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Jun 8 12:46:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:51.856046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:51.870089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bb5f6-b957-4da2-bea2-992ea43aa3bc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:51.916504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:51.917277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:51.917661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:51.917894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:51.918631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:51.918945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:51.920343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:51.933528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 435/875] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:51.934716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:51.973987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:51.976679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:51.999857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f4ef6-3c73-477c-a5e9-d2113d671e80 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:52.042416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:52.043386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.043828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.044296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.045303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:52.045909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:52.047508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:52.054759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 441/876] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:46:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:52.058897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971fd2-e9c4-450e-8801-3b950ffcb1aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:52.060946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:52.110693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:52.112362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.113086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.113086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.113682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:52.114000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:52.115415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:52.125870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 436/877] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:52.127736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:52.194006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa024446-082d-416a-bca4-840fb6854483 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:52.235498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5657a8-fef7-479c-8626-3b4500c90712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:52.236854 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5657a8-fef7-479c-8626-3b4500c90712 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.237319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5657a8-fef7-479c-8626-3b4500c90712 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.238011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5657a8-fef7-479c-8626-3b4500c90712 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.238897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5657a8-fef7-479c-8626-3b4500c90712 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:52.239216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5657a8-fef7-479c-8626-3b4500c90712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:52.240638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5657a8-fef7-479c-8626-3b4500c90712 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:52.243887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:52.246267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 442/878] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:46:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:52.248089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c04fc4-b111-4e1f-994c-e4307dedd61b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.248509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c04fc4-b111-4e1f-994c-e4307dedd61b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.248748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c04fc4-b111-4e1f-994c-e4307dedd61b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.253577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 443/879] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:52.256483 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac9a7-3c20-4f64-a188-9d5dd92c9248 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:52.258078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d1c2b-55a0-4e26-9186-978508304b45 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.258520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d1c2b-55a0-4e26-9186-978508304b45 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.258906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d1c2b-55a0-4e26-9186-978508304b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.288875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-023d1c2b-55a0-4e26-9186-978508304b45 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:52.290778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-023d1c2b-55a0-4e26-9186-978508304b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:52.303928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:52.306300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:52.307378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.308226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.308735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.309885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] RBAC: Adding query filter params (interface=public, service_id=f6b1b367fd06437f976c7f2aefeb2f76, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:52.310439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:52.312441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:52.328512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 437/880] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 8 12:46:52 2022] GET /identity/v3/endpoints?service_id=f6b1b367fd06437f976c7f2aefeb2f76&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:52.329963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:52.409648 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 444/881] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:46:52.429273 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d1c2b-55a0-4e26-9186-978508304b45 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:52.514871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7b75c-ccc2-4ec7-a573-45d370d90b63 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:52.573977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d1c2b-55a0-4e26-9186-978508304b45 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:52.587877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaee00-dc83-4c56-abc4-51a13a9f4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:52.589649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaee00-dc83-4c56-abc4-51a13a9f4205 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.590147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaee00-dc83-4c56-abc4-51a13a9f4205 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.590643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaee00-dc83-4c56-abc4-51a13a9f4205 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.591968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febaee00-dc83-4c56-abc4-51a13a9f4205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:52.593930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febaee00-dc83-4c56-abc4-51a13a9f4205 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:52.607754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 438/882] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:46:52 2022] GET /identity/v3/services => generated 1011 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:46:52.640713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:52.642241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.643358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.643863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.645117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:52.648031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:52.672738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:52.674568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:46:52.675401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:52.676641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 445/883] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:46:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:52.686829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaee00-dc83-4c56-abc4-51a13a9f4205 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:52.738097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:52.872145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaee00-dc83-4c56-abc4-51a13a9f4205 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:52.929776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21446a-b10a-4f78-9a82-b70c591f5966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:52.930885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21446a-b10a-4f78-9a82-b70c591f5966 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:52.931393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21446a-b10a-4f78-9a82-b70c591f5966 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:52.931885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21446a-b10a-4f78-9a82-b70c591f5966 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:52.933251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21446a-b10a-4f78-9a82-b70c591f5966 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:52.933815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21446a-b10a-4f78-9a82-b70c591f5966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:52.936392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21446a-b10a-4f78-9a82-b70c591f5966 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:52.945671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 439/884] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:46:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:52.950944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:52.967316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:53.079142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa50-b937-4355-8981-9d94177d2cff None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:53.119270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aef312-8d72-4cee-8e82-49b158fdfa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:53.120256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aef312-8d72-4cee-8e82-49b158fdfa5a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:53.120720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aef312-8d72-4cee-8e82-49b158fdfa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:53.121174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aef312-8d72-4cee-8e82-49b158fdfa5a None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:53.122130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aef312-8d72-4cee-8e82-49b158fdfa5a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:53.122685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aef312-8d72-4cee-8e82-49b158fdfa5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:53.124378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aef312-8d72-4cee-8e82-49b158fdfa5a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:53.131194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 446/885] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:46:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:53.991415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b20fa-623f-458c-a8e3-3d81fc7887ae None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:53.991959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b20fa-623f-458c-a8e3-3d81fc7887ae None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:53.991959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b20fa-623f-458c-a8e3-3d81fc7887ae None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:53.993644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 440/886] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:53.999471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5a245-8d9d-48d4-afe9-0816f49aee00 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:53.999951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5a245-8d9d-48d4-afe9-0816f49aee00 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:54.000053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5a245-8d9d-48d4-afe9-0816f49aee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:54.018536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-94f5a245-8d9d-48d4-afe9-0816f49aee00 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:54.019866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94f5a245-8d9d-48d4-afe9-0816f49aee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:54.115865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:54.125616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 447/887] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:46:54.168706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b20fa-623f-458c-a8e3-3d81fc7887ae None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:54.350023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:54.370970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b20fa-623f-458c-a8e3-3d81fc7887ae None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:54.440637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee25ae-9586-4ba0-be41-e30702b5be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:54.442232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee25ae-9586-4ba0-be41-e30702b5be8e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:54.442776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee25ae-9586-4ba0-be41-e30702b5be8e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:54.443571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee25ae-9586-4ba0-be41-e30702b5be8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:54.476512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee25ae-9586-4ba0-be41-e30702b5be8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d7ee25ae-9586-4ba0-be41-e30702b5be8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:46:54.493669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:54.494668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:46:54.495594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:54.496828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 441/888] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 8 12:46:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:54.507117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5a245-8d9d-48d4-afe9-0816f49aee00 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:54.671479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5a245-8d9d-48d4-afe9-0816f49aee00 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:54.734679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d9fd1-9044-4f91-9778-2ffac16f0ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:54.735377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d9fd1-9044-4f91-9778-2ffac16f0ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:54.735666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d9fd1-9044-4f91-9778-2ffac16f0ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:54.735947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d9fd1-9044-4f91-9778-2ffac16f0ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:54.737012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d9fd1-9044-4f91-9778-2ffac16f0ed8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:54.737321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d9fd1-9044-4f91-9778-2ffac16f0ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:54.738836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d9fd1-9044-4f91-9778-2ffac16f0ed8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:54.749109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 448/889] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 8 12:46:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:54.756035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee25ae-9586-4ba0-be41-e30702b5be8e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:54.961625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1370-92dc-4e7a-bc8c-3cae9984d34f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:54.962268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1370-92dc-4e7a-bc8c-3cae9984d34f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:54.962786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1370-92dc-4e7a-bc8c-3cae9984d34f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:54.968651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 449/890] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:46:54.971040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc927-1f2b-4537-8659-6b23426eadd9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:54.971616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc927-1f2b-4537-8659-6b23426eadd9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:54.972107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc927-1f2b-4537-8659-6b23426eadd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:54.983168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee25ae-9586-4ba0-be41-e30702b5be8e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:54.997875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1f7bc927-1f2b-4537-8659-6b23426eadd9 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:54.999487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1f7bc927-1f2b-4537-8659-6b23426eadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:55.028113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:55.029656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.030138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.030627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.042792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:55.044407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:55.070994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:55.071985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:55.072896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:55.072896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:55.072896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:55.072896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:55.081124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 442/891] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:55.083314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:55.084086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:55.087289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:55.099288 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 450/892] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:46:55.123940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bc927-1f2b-4537-8659-6b23426eadd9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:55.226097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecefb4-15d6-417b-8e96-4254fdd65729 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:55.240880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bc927-1f2b-4537-8659-6b23426eadd9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:55.278566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647508b-941c-4f87-81b1-23df676a1143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:55.279384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647508b-941c-4f87-81b1-23df676a1143 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.279682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647508b-941c-4f87-81b1-23df676a1143 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.279972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647508b-941c-4f87-81b1-23df676a1143 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.280774 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647508b-941c-4f87-81b1-23df676a1143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:55.281090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647508b-941c-4f87-81b1-23df676a1143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:55.282450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a153-8212-4a7e-a801-1abe2af80fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:55.282615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647508b-941c-4f87-81b1-23df676a1143 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:55.283418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a153-8212-4a7e-a801-1abe2af80fd0 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.283788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a153-8212-4a7e-a801-1abe2af80fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.284072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a153-8212-4a7e-a801-1abe2af80fd0 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.284834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a153-8212-4a7e-a801-1abe2af80fd0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:55.286311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a153-8212-4a7e-a801-1abe2af80fd0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:55.301876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 443/893] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:55.301876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7a49-b955-4bc6-b37d-504329a3b8c7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.301876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7a49-b955-4bc6-b37d-504329a3b8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.301876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7a49-b955-4bc6-b37d-504329a3b8c7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.301876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 444/894] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:55.305366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 451/895] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:46:55 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:55.308488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa5bb-6c0a-423a-b6f0-df24dfc0e8de None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.308791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa5bb-6c0a-423a-b6f0-df24dfc0e8de None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.309075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa5bb-6c0a-423a-b6f0-df24dfc0e8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.311460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a153-8212-4a7e-a801-1abe2af80fd0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:55.330404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-68cfa5bb-6c0a-423a-b6f0-df24dfc0e8de None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:55.332600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-68cfa5bb-6c0a-423a-b6f0-df24dfc0e8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:55.401123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:55.430478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:55.458454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 445/896] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:55.479080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a153-8212-4a7e-a801-1abe2af80fd0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:55.490918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa5bb-6c0a-423a-b6f0-df24dfc0e8de None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:55.522884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:55.523862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.524272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.524556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.534384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:55.536058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:46:55.552940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:55.554017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:55.555104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 452/897] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:46:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:55.560089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:55.637452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa5bb-6c0a-423a-b6f0-df24dfc0e8de None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:55.680677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a8f8d-2c33-4c59-b3e9-e58048c58d7f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:55.686125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e98faa-cab2-46f3-8e81-ee4538ef15e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:55.686937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98faa-cab2-46f3-8e81-ee4538ef15e3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.687229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98faa-cab2-46f3-8e81-ee4538ef15e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.687515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98faa-cab2-46f3-8e81-ee4538ef15e3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.688180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e98faa-cab2-46f3-8e81-ee4538ef15e3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:55.689914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e98faa-cab2-46f3-8e81-ee4538ef15e3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-89e98faa-cab2-46f3-8e81-ee4538ef15e3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:55.703692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:55.705442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:55.707605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 446/898] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:55.708401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e648c-b5d5-4938-aa8e-765153cea0c8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.708401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e648c-b5d5-4938-aa8e-765153cea0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.708401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e648c-b5d5-4938-aa8e-765153cea0c8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.709313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:55.713765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 447/899] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:55.714642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e648c-b5d5-4938-aa8e-765153cea0c8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:55.737006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e045f-7dbf-4c3f-bc96-bb7d572cdc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:55.737640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e045f-7dbf-4c3f-bc96-bb7d572cdc28 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.738094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e045f-7dbf-4c3f-bc96-bb7d572cdc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.738746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e045f-7dbf-4c3f-bc96-bb7d572cdc28 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.739928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e045f-7dbf-4c3f-bc96-bb7d572cdc28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:55.740252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e045f-7dbf-4c3f-bc96-bb7d572cdc28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:55.742547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e045f-7dbf-4c3f-bc96-bb7d572cdc28 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:55.762860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 453/900] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 8 12:46:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:55.764619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17ef0-2763-4f76-b0f4-9d399469dccb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.765112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17ef0-2763-4f76-b0f4-9d399469dccb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.765638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17ef0-2763-4f76-b0f4-9d399469dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.774396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:55.786222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-86a17ef0-2763-4f76-b0f4-9d399469dccb None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:55.787438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-86a17ef0-2763-4f76-b0f4-9d399469dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:55.834208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e648c-b5d5-4938-aa8e-765153cea0c8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:55.881081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:55.881818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:55.882115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:55.882402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:55.883123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:55.883439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:55.889772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 454/901] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:55.889772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a17ef0-2763-4f76-b0f4-9d399469dccb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:55.890008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:55.897689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 448/902] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:55.900859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:56.004664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:56.008120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a17ef0-2763-4f76-b0f4-9d399469dccb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:56.028590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66438392-5d8c-4821-ae9f-a858a2281437 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:56.046724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:56.053371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d63fd-f19a-43da-965b-c3e3d7942d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:56.054157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d63fd-f19a-43da-965b-c3e3d7942d49 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:56.054452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d63fd-f19a-43da-965b-c3e3d7942d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:56.054734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d63fd-f19a-43da-965b-c3e3d7942d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:56.069502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:56.070214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:56.070502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:56.070940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:56.071561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:56.072297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:56.073252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:56.079456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 449/903] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 8 12:46:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:56.084942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:56.132182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d63fd-f19a-43da-965b-c3e3d7942d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:56.133790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d63fd-f19a-43da-965b-c3e3d7942d49 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:56.217754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672fd3c-240e-4f5d-8fb8-d3c10a11740e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:56.255466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8625da-2f93-4367-b2f2-60cfda7aac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:56.256055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8625da-2f93-4367-b2f2-60cfda7aac09 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:56.256342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8625da-2f93-4367-b2f2-60cfda7aac09 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:56.256629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8625da-2f93-4367-b2f2-60cfda7aac09 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:56.257342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8625da-2f93-4367-b2f2-60cfda7aac09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:56.258751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8625da-2f93-4367-b2f2-60cfda7aac09 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:56.266457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:56.275359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 455/904] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:46:55 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:46:56.276161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d63fd-f19a-43da-965b-c3e3d7942d49 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:56.276294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 450/905] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:46:56 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:56.276883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8625da-2f93-4367-b2f2-60cfda7aac09 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:56.334092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:56.414667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8625da-2f93-4367-b2f2-60cfda7aac09 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:56.427326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d63fd-f19a-43da-965b-c3e3d7942d49 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:56.456612 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:56.457956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:56.458450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:56.458933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:56.469038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bee99-c69c-49ba-b30d-6216f01e819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:56.469767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bee99-c69c-49ba-b30d-6216f01e819c None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:56.470061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bee99-c69c-49ba-b30d-6216f01e819c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:56.470384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bee99-c69c-49ba-b30d-6216f01e819c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:56.471719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bee99-c69c-49ba-b30d-6216f01e819c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:56.473524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bee99-c69c-49ba-b30d-6216f01e819c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:56.475327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:56.477238 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:46:56.497939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:56.498916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:56.499823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:46:56.499823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:46:56.499823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:46:56.499823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:56.502431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 451/907] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:56.502590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 456/907] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:46:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:46:56.509461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bee99-c69c-49ba-b30d-6216f01e819c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:56.610134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:56.688267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bee99-c69c-49ba-b30d-6216f01e819c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:56.733269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:56.734290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:56.734747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:56.735180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:56.736259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:56.736865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:56.738570 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:56.755630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 457/908] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:56.759891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:56.878534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:56.908792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27f49-9bd9-4779-a4fc-005913db8c79 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:56.949061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:56.949909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:56.950201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:56.950481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:56.958954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:56.960424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:46:56.975557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:56.976494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:46:56.977392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 452/909] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:56.985626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:57.115174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ac70-a049-4c99-89b5-65dedf49ac0e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:57.131607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:57.155527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d27bb-c933-4a49-a401-55bf66d993c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:57.156603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d27bb-c933-4a49-a401-55bf66d993c8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:57.157096 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d27bb-c933-4a49-a401-55bf66d993c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:57.157605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d27bb-c933-4a49-a401-55bf66d993c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:57.159449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d27bb-c933-4a49-a401-55bf66d993c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:57.159971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d27bb-c933-4a49-a401-55bf66d993c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:57.161757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d27bb-c933-4a49-a401-55bf66d993c8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:57.175944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 458/910] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:57.181572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:57.296063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8ca47-272e-4d98-b14b-1cd4c2ad1598 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:57.341331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22720e1a-30d5-4e8a-8789-d99669b0be89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:57.342034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22720e1a-30d5-4e8a-8789-d99669b0be89 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:57.342325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22720e1a-30d5-4e8a-8789-d99669b0be89 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:57.342607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22720e1a-30d5-4e8a-8789-d99669b0be89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:57.343449 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22720e1a-30d5-4e8a-8789-d99669b0be89 None admin] RBAC: Adding query filter params (role.id=8d3f37f77181497091cc4fb28137dde6, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=256fd73e1b214911b6a2480d89b36090) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:57.343764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22720e1a-30d5-4e8a-8789-d99669b0be89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:57.345199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22720e1a-30d5-4e8a-8789-d99669b0be89 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:57.352892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 453/911] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:46:57 2022] GET /identity/v3/role_assignments?user.id=256fd73e1b214911b6a2480d89b36090&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=8d3f37f77181497091cc4fb28137dde6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:57.837904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c812-0373-42c5-8832-969eba7599d5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:57.838567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c812-0373-42c5-8832-969eba7599d5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:57.839077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c812-0373-42c5-8832-969eba7599d5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:57.840966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 459/912] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:57.847226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e2242-1113-44c5-be78-774d17b972cc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:57.847798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e2242-1113-44c5-be78-774d17b972cc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:57.848285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e2242-1113-44c5-be78-774d17b972cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:57.866028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dc2e2242-1113-44c5-be78-774d17b972cc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:57.867829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dc2e2242-1113-44c5-be78-774d17b972cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:57.876044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:57.945706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 454/913] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:57.969610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c812-0373-42c5-8832-969eba7599d5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:58.089091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c812-0373-42c5-8832-969eba7599d5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:58.126435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:58.127383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:58.127696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:58.128067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:58.128737 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:58.130177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:58.144259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:58.145253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:58.146192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 460/914] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Jun 8 12:46:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:58.151933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e2242-1113-44c5-be78-774d17b972cc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:58.268033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e2242-1113-44c5-be78-774d17b972cc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:58.309945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:58.310620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:58.310906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:58.311185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:58.311905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:58.312209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:58.313602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:58.320312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 455/915] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:46:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:58.325694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:58.390524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:58.450285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547744f9-4002-41d2-9f5a-373afe2932bb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:58.486666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:58.487357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:58.487643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:58.487928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:58.488716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:58.489030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:58.490451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:58.496534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 461/916] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:46:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:58.503161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:58.514534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:58.634390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b1c8-2266-41f9-bfe2-4782b61c44df None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:58.676195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33130b35-f5b3-411d-81a7-f2f324da110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:58.677108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33130b35-f5b3-411d-81a7-f2f324da110e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:58.677573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33130b35-f5b3-411d-81a7-f2f324da110e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:58.678005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33130b35-f5b3-411d-81a7-f2f324da110e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:58.678960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33130b35-f5b3-411d-81a7-f2f324da110e None admin] RBAC: Adding query filter params (interface=public, service_id=46643fe07b0e4dcd94c4d2d21655d019, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:58.679455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33130b35-f5b3-411d-81a7-f2f324da110e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:58.680989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33130b35-f5b3-411d-81a7-f2f324da110e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:58.687876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 456/917] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 8 12:46:58 2022] GET /identity/v3/endpoints?service_id=46643fe07b0e4dcd94c4d2d21655d019&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:58.697576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:58.786464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042c1e-5d23-418a-b928-bd1c73f56e01 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:58.787142 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042c1e-5d23-418a-b928-bd1c73f56e01 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:58.787632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042c1e-5d23-418a-b928-bd1c73f56e01 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:58.789521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 457/918] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:58.794789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a361f5-6584-4d77-98db-1e4b38131b22 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:58.795083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a361f5-6584-4d77-98db-1e4b38131b22 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:58.795368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a361f5-6584-4d77-98db-1e4b38131b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:58.816145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-68a361f5-6584-4d77-98db-1e4b38131b22 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:58.817686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-68a361f5-6584-4d77-98db-1e4b38131b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:58.873590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:58.876666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166bf80-8c37-4ad4-92c7-a0d79773962d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:58.923150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe4a0c-1691-4362-ae56-a35c738210d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:58.924549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe4a0c-1691-4362-ae56-a35c738210d4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:58.924908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe4a0c-1691-4362-ae56-a35c738210d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:58.925446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe4a0c-1691-4362-ae56-a35c738210d4 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:58.926350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe4a0c-1691-4362-ae56-a35c738210d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:58.927750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe4a0c-1691-4362-ae56-a35c738210d4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:58.941596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 462/919] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:46:58 2022] GET /identity/v3/services => generated 1497 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:46:58.943519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:58.945132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 458/920] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:46:58.971853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe4a0c-1691-4362-ae56-a35c738210d4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:59.106291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe4a0c-1691-4362-ae56-a35c738210d4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:59.147828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de2570-62c6-46d1-9479-d7843a179f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:59.149510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de2570-62c6-46d1-9479-d7843a179f7b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:59.150075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de2570-62c6-46d1-9479-d7843a179f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:59.150555 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de2570-62c6-46d1-9479-d7843a179f7b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:59.151457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de2570-62c6-46d1-9479-d7843a179f7b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:59.153156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de2570-62c6-46d1-9479-d7843a179f7b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-64de2570-62c6-46d1-9479-d7843a179f7b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:59.168449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:46:59.169533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:46:59.170420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.173745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 463/921] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:46:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:46:59.183181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a361f5-6584-4d77-98db-1e4b38131b22 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:59.302179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a361f5-6584-4d77-98db-1e4b38131b22 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:59.354685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:59.358047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:59.358370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:59.358625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:59.359096 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae714e8-7f1c-4e2b-a917-d63c01f6a630 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:59.359374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:59.359690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:59.360424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae714e8-7f1c-4e2b-a917-d63c01f6a630 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:59.361372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:59.362249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae714e8-7f1c-4e2b-a917-d63c01f6a630 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:59.365870 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 464/922] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:46:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:46:59.377516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 459/923] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:46:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:59.379926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9893486-9fd1-4ae1-8bc4-3931e4de888f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:59.383503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9893486-9fd1-4ae1-8bc4-3931e4de888f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:59.383503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9893486-9fd1-4ae1-8bc4-3931e4de888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:59.383821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:59.414304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c9893486-9fd1-4ae1-8bc4-3931e4de888f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:46:59.415924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c9893486-9fd1-4ae1-8bc4-3931e4de888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:46:59.444470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:59.504099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:59.522259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 465/924] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:46:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:46:59.566101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9893486-9fd1-4ae1-8bc4-3931e4de888f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:59.568198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5334400-ec2d-48e9-8357-10a55bebba04 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:59.607667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:59.608682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:59.609139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:59.609598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:59.610467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:59.610993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:59.612840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:59.619288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 460/925] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:46:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:46:59.625239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:59.682571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9893486-9fd1-4ae1-8bc4-3931e4de888f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:59.738428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:59.739479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:59.739998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:59.740495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:59.742315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:59.744824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:59.745346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed473f-ad75-4390-a7d6-dda00ad7a9ea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:59.747324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING keystone.server.flask.common [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 08 12:46:59.775743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:59.780895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.sql.core [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 12:46:59.780895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 08 12:46:59.780895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [parameters: {'id': '37cfb7f2d5ac4edc8e79a04ea21a2471', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 08 12:46:59.780895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80224) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 12:46:59.787237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:59.788239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:59.788705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:59.789167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:59.790237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] RBAC: Adding query filter params (interface=public, service_id=f3042acb34eb4a8c8f5bd7f3a269c72f, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:46:59.790712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:59.792383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:46:59.804010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 461/926] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 8 12:46:59 2022] GET /identity/v3/endpoints?service_id=f3042acb34eb4a8c8f5bd7f3a269c72f&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:46:59.805164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37cfb7f2d5ac4edc8e79a04ea21a2471.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37cfb7f2d5ac4edc8e79a04ea21a2471. Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 12:46:59.815922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 08 12:46:59.816988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application yield resource Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise self.value Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application session.commit() Jun 08 12:46:59.818149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.flush() Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application compat.raise_( Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 12:46:59.819053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 12:46:59.819961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 12:46:59.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [parameters: {'id': '37cfb7f2d5ac4edc8e79a04ea21a2471', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:59.821910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:46:59.822789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37cfb7f2d5ac4edc8e79a04ea21a2471. Jun 08 12:46:59.823722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:46:59.825799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 466/927] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Jun 8 12:46:59 2022] POST /identity/v3/projects => generated 262 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:46:59.829091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:46:59.898067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:46:59.934219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2a74f-10d6-4bb3-ac2f-13e4d62a1526 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:46:59.987674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183279ec-53ee-4e3b-ab52-490d08da365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:46:59.988891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183279ec-53ee-4e3b-ab52-490d08da365c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:46:59.989386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183279ec-53ee-4e3b-ab52-490d08da365c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:46:59.989916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183279ec-53ee-4e3b-ab52-490d08da365c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:46:59.990830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183279ec-53ee-4e3b-ab52-490d08da365c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:46:59.992690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183279ec-53ee-4e3b-ab52-490d08da365c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:00.009873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483a8f-8e2e-456c-9f1b-3b995df1ce5b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:00.010633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 462/928] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:46:59 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:47:00.056926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:00.057781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:00.058063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:00.058340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:00.063114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a14ac-904d-48d2-971a-31a0cd69e029 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:00.063416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a14ac-904d-48d2-971a-31a0cd69e029 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:00.063698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a14ac-904d-48d2-971a-31a0cd69e029 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:00.065955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 463/929] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:00.068031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:00.069990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:00.071685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8210-f0b7-4032-94e4-0e20aba3061a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:00.072088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8210-f0b7-4032-94e4-0e20aba3061a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:00.072475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8210-f0b7-4032-94e4-0e20aba3061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:47:00.087102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:00.088250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:00.089373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:47:00.089373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:47:00.089373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:47:00.089373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:47:00.089373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:47:00.089373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:47:00.089373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:00.089373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:00.093242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 467/930] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:46:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:00.094505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-234f8210-f0b7-4032-94e4-0e20aba3061a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:00.094629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:00.096956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-234f8210-f0b7-4032-94e4-0e20aba3061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:00.165329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:00.191969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 464/931] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:00.208831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:00.217314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f8210-f0b7-4032-94e4-0e20aba3061a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:00.246890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcdadc-5290-4a99-876d-3b99b2d4c9a5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:00.282325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:00.283646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:00.284159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:00.284472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:00.285346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:00.285688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:00.287148 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:00.318469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 468/932] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:47:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:00.376912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f8210-f0b7-4032-94e4-0e20aba3061a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:00.428993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727171d-e3f9-4e02-b467-57fbe63abaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:00.429892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727171d-e3f9-4e02-b467-57fbe63abaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:00.430185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727171d-e3f9-4e02-b467-57fbe63abaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:00.430486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727171d-e3f9-4e02-b467-57fbe63abaa3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:00.442839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727171d-e3f9-4e02-b467-57fbe63abaa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4727171d-e3f9-4e02-b467-57fbe63abaa3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:00.451331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:00.452367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:00.453230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 465/933] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 8 12:47:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:00.460167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:00.583302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812f265-c8f2-4bd2-9027-4f9e98f5e3c0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:00.625234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:00.625958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:00.626250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:00.626572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:00.627359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:00.627676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:00.629075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:00.631134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:00.641473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 469/934] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 8 12:47:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:00.651428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727171d-e3f9-4e02-b467-57fbe63abaa3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:00.729998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:00.789366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727171d-e3f9-4e02-b467-57fbe63abaa3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:00.829053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:00.830296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:00.830725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:00.831168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:00.843234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:00.844648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:00.863538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:00.864481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:00.865386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:00.865386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:00.865386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:00.865386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:00.865386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 466/935] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:00.871149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:01.006768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b46af-c617-4d1f-8cf4-3d197b158a34 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:01.053974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:01.055073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:01.055567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:01.056037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:01.056963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:01.057458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:01.059060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:01.073149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 470/936] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:01.078783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:01.203801 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18a77e-bcc1-415d-b336-a64e0a4faf0d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:01.209765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:01.252540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:01.253572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:01.253874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:01.254156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:01.263054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:01.264524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:47:01.282177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:01.283643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:47:01.284599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:01.289393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 467/937] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:47:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:01.294757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:01.383888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:01.440113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619483f1-01e7-4e69-acdb-e273acde8645 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:01.490577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:01.492521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:01.493232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:01.493891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:01.494997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:01.495544 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:01.497229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:01.519467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 471/938] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 8 12:47:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:01.529591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:01.648055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe34d8-2c67-4959-ac68-25df1975c8e1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:01.684593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:01.685406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:01.685741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:01.686027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:01.697494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:01.699006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:01.720551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:01.722513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:01.724213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:01.724213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:01.724213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:01.724213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:01.724213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 468/939] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:01.731353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:01.855094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa31f8-1ea2-4427-a6be-c3b9696282a8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:01.871978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:01.894468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cce35e-f747-4299-864c-f096333c715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:01.895148 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce35e-f747-4299-864c-f096333c715f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:01.895438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce35e-f747-4299-864c-f096333c715f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:01.895717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce35e-f747-4299-864c-f096333c715f None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:01.896458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cce35e-f747-4299-864c-f096333c715f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:01.896763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cce35e-f747-4299-864c-f096333c715f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:01.898171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cce35e-f747-4299-864c-f096333c715f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:01.911440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 472/940] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:01.917111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:01.932254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:02.040341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281f5a8-ec61-49fa-9e7d-9dc1b843c82a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:02.078073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:02.078884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.079177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.079501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.086645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761d6ac-0aa9-4b60-ade9-590d630ec9cc None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.086927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761d6ac-0aa9-4b60-ade9-590d630ec9cc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.087211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761d6ac-0aa9-4b60-ade9-590d630ec9cc None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.088857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 473/941] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:02.089120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:02.090653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:02.094187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6ea0-6233-4a6d-b046-61cb324482a6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.094489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6ea0-6233-4a6d-b046-61cb324482a6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.094772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6ea0-6233-4a6d-b046-61cb324482a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:47:02.111036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:02.111982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:02.112948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:47:02.112948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:47:02.112948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:47:02.112948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:47:02.112948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:47:02.112948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:47:02.112948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:02.112948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:02.113760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-18cd6ea0-6233-4a6d-b046-61cb324482a6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:02.113841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 469/942] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:47:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:02.114746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-18cd6ea0-6233-4a6d-b046-61cb324482a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:02.120551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:02.198909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 474/943] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:02.217374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:02.225765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6ea0-6233-4a6d-b046-61cb324482a6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:02.263078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6476d4-6d43-4bde-b2d0-05ada92c46df None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:02.308484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:02.309170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.309455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.309764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.310847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:02.311166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:02.312914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:02.333810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 470/944] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:47:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:02.335785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:02.352471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6ea0-6233-4a6d-b046-61cb324482a6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:02.355156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:02.412635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:02.413500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.413819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.414105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.414794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:02.416226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:02.434263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:02.435370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 12:47:02.436247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:02.440850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 475/945] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Jun 8 12:47:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:02.441889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:02.478211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7201caf-8100-4dc9-aaf8-d3167970d0de None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:02.512188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:02.522169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a037d-914f-45bc-a520-7ba78378b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:02.523484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a037d-914f-45bc-a520-7ba78378b38a None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.524143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a037d-914f-45bc-a520-7ba78378b38a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.524728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a037d-914f-45bc-a520-7ba78378b38a None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/256fd73e1b214911b6a2480d89b36090/roles/8d3f37f77181497091cc4fb28137dde6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.527334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a037d-914f-45bc-a520-7ba78378b38a None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=256fd73e1b214911b6a2480d89b36090, role_id=8d3f37f77181497091cc4fb28137dde6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:02.529118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a037d-914f-45bc-a520-7ba78378b38a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:02.557878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 471/946] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:47:02 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/256fd73e1b214911b6a2480d89b36090/roles/8d3f37f77181497091cc4fb28137dde6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:47:02.590530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62910eea-1152-415e-bc2c-108247f7768b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:02.635537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b819d-db38-4bf5-a0e0-b13caa20bb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:02.636232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b819d-db38-4bf5-a0e0-b13caa20bb14 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.636520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b819d-db38-4bf5-a0e0-b13caa20bb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.636818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b819d-db38-4bf5-a0e0-b13caa20bb14 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.637631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b819d-db38-4bf5-a0e0-b13caa20bb14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:02.638000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b819d-db38-4bf5-a0e0-b13caa20bb14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:02.639608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b819d-db38-4bf5-a0e0-b13caa20bb14 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:02.647509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 476/947] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:47:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:02.653563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a037d-914f-45bc-a520-7ba78378b38a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:02.748899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef35be-0651-4e29-8ee9-ebb8f56f21ee None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.749101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef35be-0651-4e29-8ee9-ebb8f56f21ee None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.749354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef35be-0651-4e29-8ee9-ebb8f56f21ee None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.752470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 477/948] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:02.758720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28307b-d3d1-4278-887e-3c11fbb6402a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.759160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28307b-d3d1-4278-887e-3c11fbb6402a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.759329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28307b-d3d1-4278-887e-3c11fbb6402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.777853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9b28307b-d3d1-4278-887e-3c11fbb6402a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:02.779097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b28307b-d3d1-4278-887e-3c11fbb6402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:02.784937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a037d-914f-45bc-a520-7ba78378b38a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:02.816274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:02.828680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:02.829378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:02.830018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:02.830345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:02.831851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:02.831851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:02.834143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:02.840466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 472/949] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:47:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:02.846758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:02.878917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 478/950] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:02.908023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28307b-d3d1-4278-887e-3c11fbb6402a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:02.914466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:02.975854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73f5de-8326-4408-94c9-15dab06026ef None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:03.030092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfd5d9-f972-474f-ad9a-b2a76f7f6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:03.030639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd5d9-f972-474f-ad9a-b2a76f7f6c50 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.030930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd5d9-f972-474f-ad9a-b2a76f7f6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.031202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd5d9-f972-474f-ad9a-b2a76f7f6c50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.031960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfd5d9-f972-474f-ad9a-b2a76f7f6c50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:03.033750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfd5d9-f972-474f-ad9a-b2a76f7f6c50 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:03.056482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 473/951] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:47:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:47:03.058726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70748b8-f840-438f-98b0-60196266d51c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.059286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70748b8-f840-438f-98b0-60196266d51c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.059783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70748b8-f840-438f-98b0-60196266d51c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.063232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 474/952] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:03.067869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28307b-d3d1-4278-887e-3c11fbb6402a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:03.077275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b13d0a-5ce4-4ff5-b284-d12915e095a5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.077704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b13d0a-5ce4-4ff5-b284-d12915e095a5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.077981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b13d0a-5ce4-4ff5-b284-d12915e095a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.108671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-46b13d0a-5ce4-4ff5-b284-d12915e095a5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:03.110896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-46b13d0a-5ce4-4ff5-b284-d12915e095a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:03.150126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:03.151796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.152308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.153318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.155008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:03.158136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:03.174179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:03.175431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:03.176385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:03.179635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 479/953] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:47:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:03.188535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:03.222810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:03.237571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 475/954] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:03.261135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b13d0a-5ce4-4ff5-b284-d12915e095a5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:03.314278 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:03.330649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708983d-5019-47b8-999e-ed6978d54571 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:03.383521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:03.384214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.384479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.384766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.385486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:03.385845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:03.387229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:03.398920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 480/955] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:47:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:03.401796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b13d0a-5ce4-4ff5-b284-d12915e095a5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:03.404863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:03.453509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:03.456086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.456553 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.457001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.458115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:03.460527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:03.462265 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING keystone.server.flask.common [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 08 12:47:03.481818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.sql.core [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 12:47:03.481818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 08 12:47:03.481818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [parameters: {'user_id': '4a39f6e816da480c8ef00a8cd0fbfd54', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 08 12:47:03.481818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80223) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jun 08 12:47:03.489925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 12:47:03.490901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application yield resource Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise self.value Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application session.commit() Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 12:47:03.492542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.flush() Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application compat.raise_( Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 12:47:03.493769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 12:47:03.494898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 12:47:03.495945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [parameters: {'user_id': '4a39f6e816da480c8ef00a8cd0fbfd54', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:03.497055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 08 12:47:03.498594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 08 12:47:03.503060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 08 12:47:03.503060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 08 12:47:03.503060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 12:47:03.503060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 12:47:03.503060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 08 12:47:03.503060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:03.503060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 476/956] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 8 12:47:03 2022] POST /identity/v3/users => generated 160 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:03.503060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:03.525855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:03.551385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560c8e0-f962-450e-bc39-246f117dbee7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:03.603505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:03.604595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.605101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.605645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.606613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:03.607201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:03.609617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:03.618978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 481/957] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:47:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:03.626766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:03.643542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3daee-6a13-4411-b434-e5fbfcb382c4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:03.646744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:03.711412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:03.713164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.714350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.715211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.734437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:03.736911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:47:03.757802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:03.758839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:03.760227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 477/958] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:47:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:03.764810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:03.773690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd9ebb-da45-49b7-a8b4-2cf4103b69ba None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:03.819316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f8382-5700-4e78-8109-9fa7e73af661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:03.820537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8382-5700-4e78-8109-9fa7e73af661 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.821419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8382-5700-4e78-8109-9fa7e73af661 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.822188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8382-5700-4e78-8109-9fa7e73af661 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.823263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f8382-5700-4e78-8109-9fa7e73af661 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:03.825110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f8382-5700-4e78-8109-9fa7e73af661 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:03.854838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 482/959] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:47:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:47:03.941430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdcf63-02aa-4960-af3e-452a3770be12 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:03.992733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d459f-0810-46f3-a9ad-31b4933edfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:03.993430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d459f-0810-46f3-a9ad-31b4933edfcf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:03.993752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d459f-0810-46f3-a9ad-31b4933edfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:03.994042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d459f-0810-46f3-a9ad-31b4933edfcf None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:03.994929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d459f-0810-46f3-a9ad-31b4933edfcf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:03.995246 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d459f-0810-46f3-a9ad-31b4933edfcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:03.996726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d459f-0810-46f3-a9ad-31b4933edfcf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:04.041855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 478/960] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 8 12:47:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:05.043641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721dbcd-04c3-4a7e-9719-1c3e1f26c8ad None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:05.044169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721dbcd-04c3-4a7e-9719-1c3e1f26c8ad None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:05.044276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721dbcd-04c3-4a7e-9719-1c3e1f26c8ad None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:05.045612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 483/961] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:05.052541 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441e1a9-6b55-4f4b-956a-73a90a08297c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:05.053039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441e1a9-6b55-4f4b-956a-73a90a08297c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:05.053716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441e1a9-6b55-4f4b-956a-73a90a08297c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:05.071616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0441e1a9-6b55-4f4b-956a-73a90a08297c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:05.073224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0441e1a9-6b55-4f4b-956a-73a90a08297c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:05.085825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:05.157982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 479/962] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:05.180905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721dbcd-04c3-4a7e-9719-1c3e1f26c8ad None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:05.191675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:05.333677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721dbcd-04c3-4a7e-9719-1c3e1f26c8ad None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:05.383696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee539c-a68c-45e4-8f59-bd1fe7596eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:05.385111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee539c-a68c-45e4-8f59-bd1fe7596eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:05.385646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee539c-a68c-45e4-8f59-bd1fe7596eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:05.386190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee539c-a68c-45e4-8f59-bd1fe7596eb9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:05.413635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee539c-a68c-45e4-8f59-bd1fe7596eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-30ee539c-a68c-45e4-8f59-bd1fe7596eb9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:05.422846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:05.424724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:05.427234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:05.430061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 484/963] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 8 12:47:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:05.434353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441e1a9-6b55-4f4b-956a-73a90a08297c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:05.571589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441e1a9-6b55-4f4b-956a-73a90a08297c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:05.615912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:05.616776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:05.617061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:05.617314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:05.618141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:05.618420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:05.619807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:05.629654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21994c-4eeb-4057-a1a1-a1a48f30759f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:05.630045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21994c-4eeb-4057-a1a1-a1a48f30759f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:05.630220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21994c-4eeb-4057-a1a1-a1a48f30759f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:05.631880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 485/964] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:05.642575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 480/965] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 8 12:47:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:05.643989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d670a-92fd-434a-a8d1-fc6c3a6fcb81 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:05.644172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:05.644316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d670a-92fd-434a-a8d1-fc6c3a6fcb81 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:05.644696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d670a-92fd-434a-a8d1-fc6c3a6fcb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:05.656471 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:05.663347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6e5d670a-92fd-434a-a8d1-fc6c3a6fcb81 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:05.664556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6e5d670a-92fd-434a-a8d1-fc6c3a6fcb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:05.760235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:05.770782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 486/966] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:05.789396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd038168-8efb-4fcf-a3a6-eaa19d5138c6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:05.793249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d670a-92fd-434a-a8d1-fc6c3a6fcb81 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:05.830511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:05.831333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:05.831622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:05.831906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:05.844381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:05.846403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:05.866350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:05.867439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:05.869082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:05.869082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:05.869082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:05.869082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:05.869082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 481/967] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:05.873234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:05.926242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d670a-92fd-434a-a8d1-fc6c3a6fcb81 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:05.948281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:05.972165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe963-673c-428d-a280-c483ded8807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:05.973299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe963-673c-428d-a280-c483ded8807d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:05.973617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe963-673c-428d-a280-c483ded8807d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:05.973901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe963-673c-428d-a280-c483ded8807d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:05.974678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fe963-673c-428d-a280-c483ded8807d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:05.976954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fe963-673c-428d-a280-c483ded8807d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-117fe963-673c-428d-a280-c483ded8807d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:06.003362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:06.004442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:06.005292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:06.007183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 487/968] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:47:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:06.011578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f117d1-2ee4-4455-bd73-dc269df5e7e8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:06.011747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe963-673c-428d-a280-c483ded8807d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:06.080504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:06.081280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:06.081533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:06.081837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:06.082584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:06.082897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:06.084293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:06.102765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:06.103763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 482/969] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:06.108600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:06.154882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe963-673c-428d-a280-c483ded8807d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:06.200632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:06.201432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:06.201754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:06.202042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:06.202891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:06.203204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:06.205182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:06.215358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 488/970] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:47:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:06.216555 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:06.257090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3860271-c97a-40c1-9e93-007ec5b4a47d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:06.295614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:06.322446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:06.323868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:06.324358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:06.324934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:06.339934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:06.341443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:47:06.357956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:06.360061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:06.362853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 483/971] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:47:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:06.365425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:06.378446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1abca-a220-4352-8d0d-90a58e977f31 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:06.422743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:06.437504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:06.438227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:06.438516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:06.438915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:06.440128 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] RBAC: Adding query filter params (type=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:06.440447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:06.441883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:06.449618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 489/972] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:47:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:06.509153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded1fe-14d6-4e04-9f6a-b72b65c4f615 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:06.551261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a34bd-3ba4-475e-8edb-69ca30362126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:06.552015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a34bd-3ba4-475e-8edb-69ca30362126 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:06.552379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a34bd-3ba4-475e-8edb-69ca30362126 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:06.552736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a34bd-3ba4-475e-8edb-69ca30362126 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:06.553707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a34bd-3ba4-475e-8edb-69ca30362126 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:06.554095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a34bd-3ba4-475e-8edb-69ca30362126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:06.555710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a34bd-3ba4-475e-8edb-69ca30362126 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:06.581595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 484/973] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 8 12:47:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:06.585001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:06.697600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e602eb1-69e5-4343-b61b-b990dc3a23bb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:06.697804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e602eb1-69e5-4343-b61b-b990dc3a23bb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:06.698098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e602eb1-69e5-4343-b61b-b990dc3a23bb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:06.699780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 485/974] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:06.705533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d083-a151-4cf1-ad54-37a05c3c278c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:06.705850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d083-a151-4cf1-ad54-37a05c3c278c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:06.706147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d083-a151-4cf1-ad54-37a05c3c278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:06.709030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff104b51-10c4-4eb6-8466-e2da1979fdfa None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:06.723932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-36d8d083-a151-4cf1-ad54-37a05c3c278c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:06.725194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-36d8d083-a151-4cf1-ad54-37a05c3c278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:06.761804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:06.762235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adaf53-b4a4-4187-a4bb-dd9fb0ee580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:06.762930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adaf53-b4a4-4187-a4bb-dd9fb0ee580a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:06.763217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adaf53-b4a4-4187-a4bb-dd9fb0ee580a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:06.763511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adaf53-b4a4-4187-a4bb-dd9fb0ee580a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:06.805664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 486/975] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:06.830513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d083-a151-4cf1-ad54-37a05c3c278c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:06.835639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:06.866297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adaf53-b4a4-4187-a4bb-dd9fb0ee580a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:06.867877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adaf53-b4a4-4187-a4bb-dd9fb0ee580a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:06.976743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d083-a151-4cf1-ad54-37a05c3c278c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.018991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.019815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.020103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.020385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.021050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.022482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.023061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 490/976] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 12:47:07.028687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adaf53-b4a4-4187-a4bb-dd9fb0ee580a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:07.045386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:07.047561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:07.048927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 487/977] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:47:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:07.057377 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:07.098952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:07.153216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:07.175108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adaf53-b4a4-4187-a4bb-dd9fb0ee580a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.197767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc810b2-764a-4c18-8576-1baf94ae04dc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.220155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.221770 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.222062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.222346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.233294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.234715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.237183 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.238100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.238687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.238796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.239493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:07.239808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.241453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.247012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 488/978] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:07.253078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:07.256192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:07.257076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:07.258187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:07.258187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:07.258187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:07.258187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:07.258187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 491/979] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:07.266140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:07.381992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547424-20c1-4f18-abf1-ee94d5d08bde None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.397959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:07.413786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81fbc0-4d44-42fa-a211-35402305d950 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.455213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.456327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.456801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.457274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.458541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:07.459064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.461248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.471823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.472887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.473669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.473669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.474786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:07.475306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.476956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:07.477253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.484172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 492/980] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:07.493116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 489/981] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:07.493307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:07.496605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:07.617390 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bcff4-5cca-40f3-8c09-ff83e45ed425 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.621194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b6519-db25-4432-8bb7-1f3bc33e6575 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.659991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.660666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.660951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.661233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.662086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] RBAC: Adding query filter params (interface=admin, service_id=f3042acb34eb4a8c8f5bd7f3a269c72f, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:07.662407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.662999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.663792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.663944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.664154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.664555 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.674941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 490/982] 10.222.0.46 () {56 vars in 1249 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/endpoints?service_id=f3042acb34eb4a8c8f5bd7f3a269c72f&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:07.676398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:07.676509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.678145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:47:07.696565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:07.697704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:07.699310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 493/983] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:07.704120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:07.715909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:07.780637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:07.838561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3fce3-628a-4cb5-b4b1-22da4d6ae9d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.838866 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce509ca8-6ccb-4852-9ef1-a13b860b727a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:07.882965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9137198-34f2-40de-987e-f6bf0de5598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.883903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137198-34f2-40de-987e-f6bf0de5598e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.884320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137198-34f2-40de-987e-f6bf0de5598e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.884769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137198-34f2-40de-987e-f6bf0de5598e None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.885703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9137198-34f2-40de-987e-f6bf0de5598e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.886553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39937fe2-5d2f-431d-9ec5-f4701f4a29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:07.887268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9137198-34f2-40de-987e-f6bf0de5598e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.887590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937fe2-5d2f-431d-9ec5-f4701f4a29af None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:07.888032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937fe2-5d2f-431d-9ec5-f4701f4a29af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:07.888477 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937fe2-5d2f-431d-9ec5-f4701f4a29af None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:07.889458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39937fe2-5d2f-431d-9ec5-f4701f4a29af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:07.890036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39937fe2-5d2f-431d-9ec5-f4701f4a29af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:07.891655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39937fe2-5d2f-431d-9ec5-f4701f4a29af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:07.895124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 491/984] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/services => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:47:07.918691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 494/985] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:07.925500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9137198-34f2-40de-987e-f6bf0de5598e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:08.032583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:08.047727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9137198-34f2-40de-987e-f6bf0de5598e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:08.087983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4f31a-e0e4-4fea-83d5-5cf86caad864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:08.088682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f31a-e0e4-4fea-83d5-5cf86caad864 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:08.088974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f31a-e0e4-4fea-83d5-5cf86caad864 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:08.089262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f31a-e0e4-4fea-83d5-5cf86caad864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:08.090187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4f31a-e0e4-4fea-83d5-5cf86caad864 None admin] RBAC: Adding query filter params (role.id=8d3f37f77181497091cc4fb28137dde6, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=256fd73e1b214911b6a2480d89b36090) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:08.090510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4f31a-e0e4-4fea-83d5-5cf86caad864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:08.092017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4f31a-e0e4-4fea-83d5-5cf86caad864 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:08.101135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 492/986] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:07 2022] GET /identity/v3/role_assignments?user.id=256fd73e1b214911b6a2480d89b36090&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=8d3f37f77181497091cc4fb28137dde6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:09.025561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ecbe-ad0d-4f29-83df-9ef197d06307 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:09.026094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ecbe-ad0d-4f29-83df-9ef197d06307 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:09.026606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ecbe-ad0d-4f29-83df-9ef197d06307 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:09.028648 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 495/987] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:09.035124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24edb1a-6769-4e3c-8e3d-b640f7c0352d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:09.035462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24edb1a-6769-4e3c-8e3d-b640f7c0352d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:09.035704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24edb1a-6769-4e3c-8e3d-b640f7c0352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:09.055531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d24edb1a-6769-4e3c-8e3d-b640f7c0352d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:09.056792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d24edb1a-6769-4e3c-8e3d-b640f7c0352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:09.140498 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 493/988] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:09.163275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ecbe-ad0d-4f29-83df-9ef197d06307 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:09.273009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ecbe-ad0d-4f29-83df-9ef197d06307 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:09.293716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:09.311530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a401c46-2b80-40a3-bc7f-3502c02ef96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:09.312263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a401c46-2b80-40a3-bc7f-3502c02ef96b None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:09.312554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a401c46-2b80-40a3-bc7f-3502c02ef96b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:09.313171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a401c46-2b80-40a3-bc7f-3502c02ef96b None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:09.314009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a401c46-2b80-40a3-bc7f-3502c02ef96b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:09.315566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a401c46-2b80-40a3-bc7f-3502c02ef96b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:09.331022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 496/989] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:47:09 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:47:10.301332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c526d-8d2c-491a-a6e1-b2681123c8b4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:10.301897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c526d-8d2c-491a-a6e1-b2681123c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:10.301977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c526d-8d2c-491a-a6e1-b2681123c8b4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:10.303446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 494/990] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:10.309155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efd6b6-bd90-43f4-8dc3-a4839e276ca0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:10.309668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efd6b6-bd90-43f4-8dc3-a4839e276ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:10.309767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efd6b6-bd90-43f4-8dc3-a4839e276ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:10.331293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-71efd6b6-bd90-43f4-8dc3-a4839e276ca0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:10.332547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-71efd6b6-bd90-43f4-8dc3-a4839e276ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:10.453597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 497/991] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:10.477002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c526d-8d2c-491a-a6e1-b2681123c8b4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:10.584994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:10.612003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c526d-8d2c-491a-a6e1-b2681123c8b4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:10.661933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:10.662788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:10.663076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:10.663356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:10.664100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:10.665513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:10.679469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:10.680557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:10.686513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 495/992] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 8 12:47:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:10.688910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efd6b6-bd90-43f4-8dc3-a4839e276ca0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:10.837869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efd6b6-bd90-43f4-8dc3-a4839e276ca0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:10.847958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:10.882572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50360bd-0934-43cf-a5b3-0231c8df1d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:10.883260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50360bd-0934-43cf-a5b3-0231c8df1d9c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:10.883549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50360bd-0934-43cf-a5b3-0231c8df1d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:10.883830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50360bd-0934-43cf-a5b3-0231c8df1d9c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:10.884554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50360bd-0934-43cf-a5b3-0231c8df1d9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:10.884872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50360bd-0934-43cf-a5b3-0231c8df1d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:10.886309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50360bd-0934-43cf-a5b3-0231c8df1d9c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:10.896808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 498/993] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:47:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:10.898193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:11.013444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbee7b-29d2-4dd6-95c6-3a57ce2e5f23 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.013823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbee7b-29d2-4dd6-95c6-3a57ce2e5f23 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.014024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbee7b-29d2-4dd6-95c6-3a57ce2e5f23 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.015434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 499/994] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:11.022219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd67dd-f0d7-480a-a8da-83eeb5042091 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.022522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd67dd-f0d7-480a-a8da-83eeb5042091 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.022782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd67dd-f0d7-480a-a8da-83eeb5042091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.038579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986925-86be-404a-9b75-6068ff6af339 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:11.051773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f4fd67dd-f0d7-480a-a8da-83eeb5042091 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:11.053348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f4fd67dd-f0d7-480a-a8da-83eeb5042091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:11.080654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:11.081279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.081602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.081892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.082635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:11.082960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:11.084364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:11.095740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 496/995] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 8 12:47:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:11.097360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:11.112800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:11.154319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 500/996] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:11.178461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd67dd-f0d7-480a-a8da-83eeb5042091 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:11.231014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fefd48-a1c2-4822-a7b7-f8b4c6f55f54 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:11.273143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ccc6e-10b4-4baa-9a9f-0bd0d7058e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:11.274016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ccc6e-10b4-4baa-9a9f-0bd0d7058e1a None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.274311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ccc6e-10b4-4baa-9a9f-0bd0d7058e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.274600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ccc6e-10b4-4baa-9a9f-0bd0d7058e1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.275373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ccc6e-10b4-4baa-9a9f-0bd0d7058e1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:11.276785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ccc6e-10b4-4baa-9a9f-0bd0d7058e1a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:11.293840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:11.298600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd67dd-f0d7-480a-a8da-83eeb5042091 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:11.301769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 497/997] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:47:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:47:11.354915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:11.356573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.357207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.357731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] PATH_INFO: `/v3/services/image` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.358647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:11.361081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:11.375116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:11.376955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:11.378298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:11.382032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 501/998] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Jun 8 12:47:11 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:11.385832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ccc6e-10b4-4baa-9a9f-0bd0d7058e1a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:11.478425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:11.525160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ccc6e-10b4-4baa-9a9f-0bd0d7058e1a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:11.581985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749e454-b23e-4c1e-8570-7dc4fe65d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:11.582702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749e454-b23e-4c1e-8570-7dc4fe65d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.582995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749e454-b23e-4c1e-8570-7dc4fe65d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.583267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749e454-b23e-4c1e-8570-7dc4fe65d4f3 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.584025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749e454-b23e-4c1e-8570-7dc4fe65d4f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:11.584337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749e454-b23e-4c1e-8570-7dc4fe65d4f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:11.585796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749e454-b23e-4c1e-8570-7dc4fe65d4f3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:11.597592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 498/999] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:11.599651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:11.762108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81c162-3253-4854-9179-41e7dae2e733 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:11.814616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb037b-bc57-4a5b-a6d4-e4511f79293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:11.815746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb037b-bc57-4a5b-a6d4-e4511f79293c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.816964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb037b-bc57-4a5b-a6d4-e4511f79293c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.816964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb037b-bc57-4a5b-a6d4-e4511f79293c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.817777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb037b-bc57-4a5b-a6d4-e4511f79293c None admin] RBAC: Adding query filter params (type=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:11.818103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb037b-bc57-4a5b-a6d4-e4511f79293c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:11.819533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb037b-bc57-4a5b-a6d4-e4511f79293c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:11.833661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 502/1000] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:11.880745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d2de-b82e-4ae9-af5d-73ad4b9d1cb2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.881047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d2de-b82e-4ae9-af5d-73ad4b9d1cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.881315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d2de-b82e-4ae9-af5d-73ad4b9d1cb2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.882937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 499/1001] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:11.888590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190978eb-7e25-47a5-a4c9-852a1b4449d0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:11.888927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190978eb-7e25-47a5-a4c9-852a1b4449d0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:11.889172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190978eb-7e25-47a5-a4c9-852a1b4449d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:11.908626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-190978eb-7e25-47a5-a4c9-852a1b4449d0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:11.910015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-190978eb-7e25-47a5-a4c9-852a1b4449d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:11.936106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:12.017663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 503/1002] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:12.054207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737d2de-b82e-4ae9-af5d-73ad4b9d1cb2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:12.185658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737d2de-b82e-4ae9-af5d-73ad4b9d1cb2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:12.244241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:12.246149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:12.246926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:12.247735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:12.249271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:12.253227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:12.256789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:12.269220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:12.270501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:12.271352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:12.272559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 500/1003] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:47:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:12.277257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190978eb-7e25-47a5-a4c9-852a1b4449d0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:12.427980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190978eb-7e25-47a5-a4c9-852a1b4449d0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:12.471638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:12.472319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:12.472602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:12.472879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:12.473790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:12.474108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:12.475485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:12.484966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 504/1004] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:47:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:12.487086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:12.611749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02bcf-b58e-428f-aead-84c7b25e27d9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:12.665650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:12.666822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:12.667310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:12.667820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:12.669119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:12.669709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:12.672189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:12.685422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 501/1005] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:47:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:12.689417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:12.727239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:12.822179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5246888-f618-4e46-8293-5d714b24b307 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:12.858673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d90449-10ae-4fce-a4b3-c7815fd4a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:12.859358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d90449-10ae-4fce-a4b3-c7815fd4a310 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:12.859650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d90449-10ae-4fce-a4b3-c7815fd4a310 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:12.859957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d90449-10ae-4fce-a4b3-c7815fd4a310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:12.860810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d90449-10ae-4fce-a4b3-c7815fd4a310 None admin] RBAC: Adding query filter params (interface=public, service_id=e3ea8792ddc64742b454e396a283e171, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:12.861134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d90449-10ae-4fce-a4b3-c7815fd4a310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:12.862630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d90449-10ae-4fce-a4b3-c7815fd4a310 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:12.873257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 505/1006] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 8 12:47:12 2022] GET /identity/v3/endpoints?service_id=e3ea8792ddc64742b454e396a283e171&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:12.874920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:12.955559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:13.004563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac767-e45a-4e60-ac40-a29a6c09cb02 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:13.040242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5008d6c-560f-48cd-ab6c-55c8699b54c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:13.040927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5008d6c-560f-48cd-ab6c-55c8699b54c9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:13.041218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5008d6c-560f-48cd-ab6c-55c8699b54c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:13.041502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5008d6c-560f-48cd-ab6c-55c8699b54c9 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:13.042223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5008d6c-560f-48cd-ab6c-55c8699b54c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:13.043602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5008d6c-560f-48cd-ab6c-55c8699b54c9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:13.057613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 502/1007] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:47:12 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:47:13.939660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a408-6efa-49ed-8349-1b876d18d301 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:13.940310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a408-6efa-49ed-8349-1b876d18d301 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:13.940566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a408-6efa-49ed-8349-1b876d18d301 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:13.943258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 506/1008] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:13.951942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6654599-e343-4ba7-bb01-16f9a5f7fcc5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:13.952469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6654599-e343-4ba7-bb01-16f9a5f7fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:13.952904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6654599-e343-4ba7-bb01-16f9a5f7fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:13.982699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d6654599-e343-4ba7-bb01-16f9a5f7fcc5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:13.984785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d6654599-e343-4ba7-bb01-16f9a5f7fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:14.105717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 503/1009] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:14.132128 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119a408-6efa-49ed-8349-1b876d18d301 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:14.245667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:14.269624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119a408-6efa-49ed-8349-1b876d18d301 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:14.322154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465736d-32ef-4959-b1e9-cc6bf4d2cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:14.323437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465736d-32ef-4959-b1e9-cc6bf4d2cd7d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:14.323928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465736d-32ef-4959-b1e9-cc6bf4d2cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:14.324403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465736d-32ef-4959-b1e9-cc6bf4d2cd7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:14.326437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465736d-32ef-4959-b1e9-cc6bf4d2cd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:14.329659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465736d-32ef-4959-b1e9-cc6bf4d2cd7d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:14.337203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 507/1010] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:14.338550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6654599-e343-4ba7-bb01-16f9a5f7fcc5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:14.353590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba77c5-b5b5-48e2-9db9-f519f053db80 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:14.353991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba77c5-b5b5-48e2-9db9-f519f053db80 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:14.354277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba77c5-b5b5-48e2-9db9-f519f053db80 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:14.355791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 508/1011] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:14.362894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016cede-6ffe-47e8-b9fd-326cbf2960b9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:14.363319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016cede-6ffe-47e8-b9fd-326cbf2960b9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:14.363799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016cede-6ffe-47e8-b9fd-326cbf2960b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:14.387905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6016cede-6ffe-47e8-b9fd-326cbf2960b9 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:14.389862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6016cede-6ffe-47e8-b9fd-326cbf2960b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:14.427329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:14.480122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 509/1012] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:14.486170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6654599-e343-4ba7-bb01-16f9a5f7fcc5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:14.505915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016cede-6ffe-47e8-b9fd-326cbf2960b9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:14.529070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dc1e8-d3b3-4e61-966a-a00a824e9c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:14.529784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc1e8-d3b3-4e61-966a-a00a824e9c10 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:14.530069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc1e8-d3b3-4e61-966a-a00a824e9c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:14.530350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc1e8-d3b3-4e61-966a-a00a824e9c10 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:14.531081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dc1e8-d3b3-4e61-966a-a00a824e9c10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:14.533245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dc1e8-d3b3-4e61-966a-a00a824e9c10 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:14.573579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 504/1013] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:47:14 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:47:14.626139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:14.635578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016cede-6ffe-47e8-b9fd-326cbf2960b9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:14.680924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc21377-4fe2-49d2-8196-28e2dce3eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:14.681656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21377-4fe2-49d2-8196-28e2dce3eb57 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:14.681951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21377-4fe2-49d2-8196-28e2dce3eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:14.682234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21377-4fe2-49d2-8196-28e2dce3eb57 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:14.682998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc21377-4fe2-49d2-8196-28e2dce3eb57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:14.684452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc21377-4fe2-49d2-8196-28e2dce3eb57 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:14.703741 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 510/1014] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:47:14 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:47:15.709031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8e83-6215-4c06-a2b6-03d7e4e40721 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:15.709537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8e83-6215-4c06-a2b6-03d7e4e40721 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:15.709537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8e83-6215-4c06-a2b6-03d7e4e40721 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:15.711095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 505/1015] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:15.716246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1315c-06d1-40b3-ab99-66f8eed8896f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:15.716672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1315c-06d1-40b3-ab99-66f8eed8896f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:15.716837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1315c-06d1-40b3-ab99-66f8eed8896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:15.734322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-81b1315c-06d1-40b3-ab99-66f8eed8896f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:15.735635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-81b1315c-06d1-40b3-ab99-66f8eed8896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:15.834295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 511/1016] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:15 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:15.857467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8e83-6215-4c06-a2b6-03d7e4e40721 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:16.007070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8e83-6215-4c06-a2b6-03d7e4e40721 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:16.017460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:16.046035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:16.046875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:16.047143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:16.047431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:16.048631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:16.050243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:16.064080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:16.066219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 12:47:16.067703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:16.069776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 506/1017] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:47:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:16.071719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1315c-06d1-40b3-ab99-66f8eed8896f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:16.172414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:16.215209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1315c-06d1-40b3-ab99-66f8eed8896f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:16.265712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:16.266860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:16.267155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:16.267536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:16.268270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:16.268579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:16.270015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:16.276042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 512/1018] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:47:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:16.281489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:16.419437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf32ab-3b22-4d70-a455-dd8c0d753de8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:16.459560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143994ab-c08b-4882-80ed-6f7b3983859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:16.460461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143994ab-c08b-4882-80ed-6f7b3983859c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:16.460752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143994ab-c08b-4882-80ed-6f7b3983859c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:16.461228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143994ab-c08b-4882-80ed-6f7b3983859c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:16.462114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143994ab-c08b-4882-80ed-6f7b3983859c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:16.462435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143994ab-c08b-4882-80ed-6f7b3983859c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:16.463845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143994ab-c08b-4882-80ed-6f7b3983859c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:16.473120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 507/1019] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 8 12:47:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:16.480537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:16.606907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc716-808a-4767-bd30-6c2e1b1f9566 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:16.642321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:16.650667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71cf7-c410-450f-89a8-0770b3e233b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:16.651343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71cf7-c410-450f-89a8-0770b3e233b1 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:16.651633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71cf7-c410-450f-89a8-0770b3e233b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:16.651916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71cf7-c410-450f-89a8-0770b3e233b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:16.652675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a71cf7-c410-450f-89a8-0770b3e233b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:16.654118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a71cf7-c410-450f-89a8-0770b3e233b1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:16.680919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 513/1020] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:47:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:47:17.044639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fcc2f-26c3-4715-971f-4666c67390d8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.045149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fcc2f-26c3-4715-971f-4666c67390d8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.045149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fcc2f-26c3-4715-971f-4666c67390d8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.046667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 508/1021] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:17.052491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9949a2-492b-423c-9c8c-05d6a0fa1f5c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.052928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9949a2-492b-423c-9c8c-05d6a0fa1f5c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.053121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9949a2-492b-423c-9c8c-05d6a0fa1f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.070807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bf9949a2-492b-423c-9c8c-05d6a0fa1f5c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:17.072010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf9949a2-492b-423c-9c8c-05d6a0fa1f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:17.130880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746234e-f6ac-4e66-b431-edb5f056f927 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.131184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746234e-f6ac-4e66-b431-edb5f056f927 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.131430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746234e-f6ac-4e66-b431-edb5f056f927 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.132972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 509/1022] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:17.138180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ffd7c-8ab2-4952-b753-59a35724d13d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.138472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ffd7c-8ab2-4952-b753-59a35724d13d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.138763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ffd7c-8ab2-4952-b753-59a35724d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.156524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 514/1023] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:17.160736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-509ffd7c-8ab2-4952-b753-59a35724d13d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:17.162194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-509ffd7c-8ab2-4952-b753-59a35724d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:17.182906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9949a2-492b-423c-9c8c-05d6a0fa1f5c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:17.208362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:17.265680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 510/1024] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:17.290863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ffd7c-8ab2-4952-b753-59a35724d13d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:17.310486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9949a2-492b-423c-9c8c-05d6a0fa1f5c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:17.340270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:17.384807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d51b7-b614-4543-8a08-ae03f021c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:17.386203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d51b7-b614-4543-8a08-ae03f021c65a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.386788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d51b7-b614-4543-8a08-ae03f021c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.387618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d51b7-b614-4543-8a08-ae03f021c65a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.389392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d51b7-b614-4543-8a08-ae03f021c65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:17.393958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d51b7-b614-4543-8a08-ae03f021c65a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:17.396099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 515/1025] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:17.401866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d51b7-b614-4543-8a08-ae03f021c65a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:17.444460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ffd7c-8ab2-4952-b753-59a35724d13d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:17.494232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:17.495551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.495841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.496212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] PATH_INFO: `/v3/services/image` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.496785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:17.498212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:17.510356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:17.511516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:17.514497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 511/1026] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Jun 8 12:47:17 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:17.519259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:17.538871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d51b7-b614-4543-8a08-ae03f021c65a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:17.560908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:17.590368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc159d-40eb-4f62-b359-6c05d4c15687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:17.591428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc159d-40eb-4f62-b359-6c05d4c15687 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.591896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc159d-40eb-4f62-b359-6c05d4c15687 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.592361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc159d-40eb-4f62-b359-6c05d4c15687 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.593608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc159d-40eb-4f62-b359-6c05d4c15687 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:17.595757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc159d-40eb-4f62-b359-6c05d4c15687 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:17.625419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 516/1027] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:47:17 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:47:17.666079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d76e29-6ff9-4a71-98ee-0acbc2cde49c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:17.711874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:17.712639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.712929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.713209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.713983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:17.714303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:17.715721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:17.722021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 512/1028] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:17.730865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc159d-40eb-4f62-b359-6c05d4c15687 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:17.795679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:17.882802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc159d-40eb-4f62-b359-6c05d4c15687 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:17.919321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:17.920006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:17.920297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:17.920579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:17.921353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] RBAC: Adding query filter params (type=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:17.921641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:17.923682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:17.929517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 517/1029] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:17.935376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:18.039199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:18.046709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b34b-971e-4b2b-913a-abc4231d89b7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:18.084105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd98e0-051c-4615-ab96-6bb79da48f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:18.084783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd98e0-051c-4615-ab96-6bb79da48f19 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:18.085071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd98e0-051c-4615-ab96-6bb79da48f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:18.085353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd98e0-051c-4615-ab96-6bb79da48f19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:18.086182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd98e0-051c-4615-ab96-6bb79da48f19 None admin] RBAC: Adding query filter params (interface=public, service_id=8d0d401d39f441669d91fa38e910d2e2, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:18.086501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd98e0-051c-4615-ab96-6bb79da48f19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:18.087894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd98e0-051c-4615-ab96-6bb79da48f19 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:18.093633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 513/1030] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 8 12:47:17 2022] GET /identity/v3/endpoints?service_id=8d0d401d39f441669d91fa38e910d2e2&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:18.100327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:18.209725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:18.214473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da41e53-2fbc-41fb-9f57-43176d039c32 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:18.265110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e36a85-fa3a-4e68-83a2-e6de8d7af794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:18.266778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e36a85-fa3a-4e68-83a2-e6de8d7af794 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:18.267299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e36a85-fa3a-4e68-83a2-e6de8d7af794 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:18.267807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e36a85-fa3a-4e68-83a2-e6de8d7af794 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:18.269044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e36a85-fa3a-4e68-83a2-e6de8d7af794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:18.271459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e36a85-fa3a-4e68-83a2-e6de8d7af794 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:18.284368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 518/1031] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:47:18 2022] GET /identity/v3/services => generated 1957 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:47:19.152250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da17f7-dd36-43c1-87d5-bb9c9d501f17 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:19.153033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da17f7-dd36-43c1-87d5-bb9c9d501f17 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:19.153221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da17f7-dd36-43c1-87d5-bb9c9d501f17 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:19.155913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 514/1032] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:19.162511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9fa3-f20f-4eae-9097-168551e56931 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:19.163273 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9fa3-f20f-4eae-9097-168551e56931 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:19.163273 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9fa3-f20f-4eae-9097-168551e56931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:19.182656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-22bc9fa3-f20f-4eae-9097-168551e56931 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:19.182656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-22bc9fa3-f20f-4eae-9097-168551e56931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:19.266740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 519/1033] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:19.291720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da17f7-dd36-43c1-87d5-bb9c9d501f17 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:19.421136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da17f7-dd36-43c1-87d5-bb9c9d501f17 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:19.458472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f34e8d-2de5-472e-89b7-db85ce56b30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:19.459314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34e8d-2de5-472e-89b7-db85ce56b30d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:19.459606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34e8d-2de5-472e-89b7-db85ce56b30d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:19.459884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34e8d-2de5-472e-89b7-db85ce56b30d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:19.472633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f34e8d-2de5-472e-89b7-db85ce56b30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b1f34e8d-2de5-472e-89b7-db85ce56b30d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:19.480708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:19.481781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:19.482626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:19.483936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 515/1034] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 8 12:47:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:19.488443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc9fa3-f20f-4eae-9097-168551e56931 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:19.592555 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:19.601989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc9fa3-f20f-4eae-9097-168551e56931 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:19.638583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:19.639272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:19.639562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:19.639848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:19.640607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:19.640952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:19.642619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:19.655708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 520/1035] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 8 12:47:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:19.657656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f34e8d-2de5-472e-89b7-db85ce56b30d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:19.679293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:19.773681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f34e8d-2de5-472e-89b7-db85ce56b30d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:19.808629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b214-b943-444a-9fb5-fd5b4e5e2ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:19.809436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b214-b943-444a-9fb5-fd5b4e5e2ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:19.809754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b214-b943-444a-9fb5-fd5b4e5e2ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:19.810040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b214-b943-444a-9fb5-fd5b4e5e2ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:19.824806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b214-b943-444a-9fb5-fd5b4e5e2ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:19.826347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b214-b943-444a-9fb5-fd5b4e5e2ef5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a4e8b214-b943-444a-9fb5-fd5b4e5e2ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:19.845704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:19.846832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:19.847811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:19.847811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:19.847811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:19.847811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:19.849924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 516/1036] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:19.852696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:20.018744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c33631-b44a-437a-9f9d-468daf1a78a6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:20.067394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0981d9-37be-41dc-8e46-768a09794d44 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.067777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0981d9-37be-41dc-8e46-768a09794d44 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.067940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0981d9-37be-41dc-8e46-768a09794d44 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.069485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 517/1037] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:20.076283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5509-fd90-42b6-9572-bca63cdaa583 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.076779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5509-fd90-42b6-9572-bca63cdaa583 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.076902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:20.077244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5509-fd90-42b6-9572-bca63cdaa583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.077457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.077780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.078069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.078845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:20.079160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:20.080575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:20.093793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 521/1038] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:20.096603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e42e5509-fd90-42b6-9572-bca63cdaa583 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:20.097842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e42e5509-fd90-42b6-9572-bca63cdaa583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:20.100615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:20.128969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:20.173975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:20.180087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 518/1039] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:20.204655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e5509-fd90-42b6-9572-bca63cdaa583 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:20.227751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53170d8-63b8-4e4e-88ca-2070ad6088e9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:20.272739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:20.273476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.273791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.274069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.283214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:20.284738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:47:20.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:20.303527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:20.304624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 522/1040] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:47:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:20.309653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:20.331850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e5509-fd90-42b6-9572-bca63cdaa583 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:20.372601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc73e6-16b1-4ba9-811d-c9910d665376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:20.373507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc73e6-16b1-4ba9-811d-c9910d665376 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.373830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc73e6-16b1-4ba9-811d-c9910d665376 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.374113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc73e6-16b1-4ba9-811d-c9910d665376 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.386714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc73e6-16b1-4ba9-811d-c9910d665376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-52bc73e6-16b1-4ba9-811d-c9910d665376 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:20.394675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:20.395689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:20.396539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 519/1041] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:47:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:20.401106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:20.401820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc73e6-16b1-4ba9-811d-c9910d665376 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:20.431563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b11989-932b-4d18-98a5-ce53deeb1785 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:20.470830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:20.471521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.471815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.472103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.472972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:20.473289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:20.474798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:20.483843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:20.494356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 523/1042] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:47:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:20.501682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:20.543986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc73e6-16b1-4ba9-811d-c9910d665376 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:20.584458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:20.585121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.585419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.585707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.586647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:20.586953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:20.588760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:20.598353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 520/1043] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:47:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:20.603818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:20.629037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15ea1-eeb4-45c9-a440-7f40c34f48f2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:20.666268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485c64d-4dcd-4b43-9a60-624611e8ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:20.666951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485c64d-4dcd-4b43-9a60-624611e8ed99 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.667240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485c64d-4dcd-4b43-9a60-624611e8ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.667522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485c64d-4dcd-4b43-9a60-624611e8ed99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.670699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:20.714458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20324d56-0ddc-4442-9077-690b8deaf8f2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:20.739159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:20.744643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485c64d-4dcd-4b43-9a60-624611e8ed99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:20.746167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485c64d-4dcd-4b43-9a60-624611e8ed99 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:20.753057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6346d22-e1fc-418b-b443-bcd744d82a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:20.753979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6346d22-e1fc-418b-b443-bcd744d82a30 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.754267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6346d22-e1fc-418b-b443-bcd744d82a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.754552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6346d22-e1fc-418b-b443-bcd744d82a30 None admin] PATH_INFO: `/v3/users/61a377867fc4469e94f0715535495cef` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.770028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6346d22-e1fc-418b-b443-bcd744d82a30 None admin] RBAC: Authorizing `identity:get_user(user_id=61a377867fc4469e94f0715535495cef)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:20.772475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6346d22-e1fc-418b-b443-bcd744d82a30 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:20.775396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 521/1044] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:20 2022] GET /identity/v3/users/61a377867fc4469e94f0715535495cef => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:20.777490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700789-af0e-4852-bd75-54aa0ba47bbf None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.777982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700789-af0e-4852-bd75-54aa0ba47bbf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.778411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700789-af0e-4852-bd75-54aa0ba47bbf None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.780482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 522/1045] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:20.781668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4700789-af0e-4852-bd75-54aa0ba47bbf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:20.863333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 524/1046] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:47:20.864663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0866-31ec-4a38-ab52-89818fe2db46 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.864963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0866-31ec-4a38-ab52-89818fe2db46 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.865247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0866-31ec-4a38-ab52-89818fe2db46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.882582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1f7e0866-31ec-4a38-ab52-89818fe2db46 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:20.883801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1f7e0866-31ec-4a38-ab52-89818fe2db46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:20.917519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4700789-af0e-4852-bd75-54aa0ba47bbf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:20.925118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:20.952978 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dc227-3ae5-4e15-967e-5b1b878bcf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:20.954293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc227-3ae5-4e15-967e-5b1b878bcf8c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:20.954757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc227-3ae5-4e15-967e-5b1b878bcf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:20.954971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc227-3ae5-4e15-967e-5b1b878bcf8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:20.969824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 525/1047] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:20.970819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e0866-31ec-4a38-ab52-89818fe2db46 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.007366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:21.027957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dc227-3ae5-4e15-967e-5b1b878bcf8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.029395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dc227-3ae5-4e15-967e-5b1b878bcf8c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.074981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e0866-31ec-4a38-ab52-89818fe2db46 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.108970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.109806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.110098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.110383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.121243 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.122673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.131678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 523/1048] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:47:21.132526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dc227-3ae5-4e15-967e-5b1b878bcf8c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:21.146086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:21.147055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:21.147980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:21.147980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:21.147980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:21.147980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:21.147980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 526/1049] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:21.148272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.167965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:21.216265 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:21.237031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dc227-3ae5-4e15-967e-5b1b878bcf8c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.259737 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51e71-4370-4762-ad51-6de6b8d6af4b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.280527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.281846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.282804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.283231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] PATH_INFO: `/v3/services/image` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.284272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.286506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:21.301589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:21.303890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:21.305609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 524/1050] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:21.307208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.316805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33da42-2f67-4155-bcaa-e8134da70c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.318265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33da42-2f67-4155-bcaa-e8134da70c07 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.318557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33da42-2f67-4155-bcaa-e8134da70c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.318842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33da42-2f67-4155-bcaa-e8134da70c07 None admin] PATH_INFO: `/v3/projects/6e2129a17373485f8b5c57afb0be10aa` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.325460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33da42-2f67-4155-bcaa-e8134da70c07 None admin] RBAC: Authorizing `identity:get_project(project_id=6e2129a17373485f8b5c57afb0be10aa)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.325881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33da42-2f67-4155-bcaa-e8134da70c07 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.334248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 527/1051] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/projects/6e2129a17373485f8b5c57afb0be10aa => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:21.334248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33da42-2f67-4155-bcaa-e8134da70c07 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.425176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:21.435015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764327e9-d235-42aa-95ba-4ab16128e274 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.442888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33da42-2f67-4155-bcaa-e8134da70c07 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.476235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.476918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.477208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.477491 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.478276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:21.478588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.479981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.491987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.492676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.492970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.493259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.494013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] RBAC: Adding query filter params (name=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:21.494320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 525/1052] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:21.494418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.495166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.495706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.498789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:21.508409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 528/1053] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:21.508409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.615907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d05bb-3305-4f2d-91e1-be71b9fbf48f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.637147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed33d3f-86d8-4491-83a4-61d229295a1a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.654448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.655259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.655551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.655839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.662948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.664336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.675540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.676213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.676504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.676787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.677668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=6e2129a17373485f8b5c57afb0be10aa, user.id=61a377867fc4469e94f0715535495cef) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:21.677984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.679425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:47:21.680678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:21.681630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 529/1054] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:21.682877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.693674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 526/1055] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/role_assignments?user.id=61a377867fc4469e94f0715535495cef&scope.project.id=6e2129a17373485f8b5c57afb0be10aa&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:21.693674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.700792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:21.783577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:21.813695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164be3b6-4490-4271-86a2-5250436529f0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.827097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2049e-c706-4522-bd8e-579729a6133a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:21.867553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.869050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.869516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.870009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.871266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] RBAC: Adding query filter params (type=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:21.871785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.874285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.885605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 530/1056] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:21.885848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:21.885848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:21.885848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:21.885848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:21.886418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:21.886418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:21.887707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:21.889974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.912782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 527/1057] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:21.912782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:21.980567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:22.019592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b018-7202-47a8-8773-6ff8288be953 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:22.029870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0da2f7-07f6-4152-8e6b-04b9a8f5fae8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:22.061357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186847f-39ab-44e9-9e0b-a385c7c248ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:22.062383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186847f-39ab-44e9-9e0b-a385c7c248ee None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:22.062858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186847f-39ab-44e9-9e0b-a385c7c248ee None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:22.063818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186847f-39ab-44e9-9e0b-a385c7c248ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:22.064181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:22.065170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186847f-39ab-44e9-9e0b-a385c7c248ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:22.068121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186847f-39ab-44e9-9e0b-a385c7c248ee None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:22.076859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592da3be-6669-4192-81a3-16985864a8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:22.077944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da3be-6669-4192-81a3-16985864a8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:22.078405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da3be-6669-4192-81a3-16985864a8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:22.080002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da3be-6669-4192-81a3-16985864a8b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:22.081483 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da3be-6669-4192-81a3-16985864a8b4 None admin] RBAC: Adding query filter params (role.id=8d3f37f77181497091cc4fb28137dde6, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=63fe1877e3334a29b3bdfa0ba22174da) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:22.081945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da3be-6669-4192-81a3-16985864a8b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:22.084411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da3be-6669-4192-81a3-16985864a8b4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:22.101706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 528/1058] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:21 2022] GET /identity/v3/role_assignments?user.id=63fe1877e3334a29b3bdfa0ba22174da&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=8d3f37f77181497091cc4fb28137dde6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:22.104970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 531/1059] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:47:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:47:24.058847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b23256-cbae-4040-a6ee-31786e1cf48f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.059402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b23256-cbae-4040-a6ee-31786e1cf48f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.059402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b23256-cbae-4040-a6ee-31786e1cf48f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.060809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 529/1060] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:24.067020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cab24-c30b-489b-9753-450d346ffd11 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.067478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cab24-c30b-489b-9753-450d346ffd11 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.067590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cab24-c30b-489b-9753-450d346ffd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.086393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fa3cab24-c30b-489b-9753-450d346ffd11 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:24.087617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fa3cab24-c30b-489b-9753-450d346ffd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:24.171278 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 532/1061] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:24.195159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b23256-cbae-4040-a6ee-31786e1cf48f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:24.321775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b23256-cbae-4040-a6ee-31786e1cf48f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:24.358975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06338f-c065-426e-aabb-6f3a75260e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:24.360280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06338f-c065-426e-aabb-6f3a75260e47 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.360613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06338f-c065-426e-aabb-6f3a75260e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.361024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06338f-c065-426e-aabb-6f3a75260e47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.374991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06338f-c065-426e-aabb-6f3a75260e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-fe06338f-c065-426e-aabb-6f3a75260e47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:24.384051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:24.385018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:24.385998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:24.393894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 530/1062] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:47:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:24.396895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cab24-c30b-489b-9753-450d346ffd11 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:24.469739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:24.525233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9944cf8-fb7f-4897-82cb-eb86c5dba524 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.525609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9944cf8-fb7f-4897-82cb-eb86c5dba524 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.526218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9944cf8-fb7f-4897-82cb-eb86c5dba524 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.528003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 531/1063] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:24.533897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73f856-3f4b-46c3-b248-d1cb168baa58 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.534192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73f856-3f4b-46c3-b248-d1cb168baa58 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.534477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73f856-3f4b-46c3-b248-d1cb168baa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.539941 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cab24-c30b-489b-9753-450d346ffd11 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:24.553102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8c73f856-3f4b-46c3-b248-d1cb168baa58 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:24.554204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8c73f856-3f4b-46c3-b248-d1cb168baa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:24.596846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:24.597882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.598328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.598806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.600105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:24.600635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:24.603107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:24.616973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 533/1064] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:47:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:24.627061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:24.644408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:24.675974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 532/1065] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:24.699814 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73f856-3f4b-46c3-b248-d1cb168baa58 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:24.764616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc7d74-c6a7-4cf5-9d67-c5ff3d31fff3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:24.782279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:24.801863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e36fd0-6c68-4a22-95c4-9dce7fa87b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:24.802746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36fd0-6c68-4a22-95c4-9dce7fa87b5d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.803033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36fd0-6c68-4a22-95c4-9dce7fa87b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.803310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36fd0-6c68-4a22-95c4-9dce7fa87b5d None admin] PATH_INFO: `/v3/users/61a377867fc4469e94f0715535495cef` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.804550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e36fd0-6c68-4a22-95c4-9dce7fa87b5d None admin] RBAC: Authorizing `identity:get_user(user_id=61a377867fc4469e94f0715535495cef)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:24.806060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e36fd0-6c68-4a22-95c4-9dce7fa87b5d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:24.807734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 534/1066] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:24 2022] GET /identity/v3/users/61a377867fc4469e94f0715535495cef => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:24.808961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c608-8d88-4ced-8358-beda525c2be4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.809247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c608-8d88-4ced-8358-beda525c2be4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.809526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c608-8d88-4ced-8358-beda525c2be4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.810794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 535/1067] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:24.813830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c608-8d88-4ced-8358-beda525c2be4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:24.816384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73f856-3f4b-46c3-b248-d1cb168baa58 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:24.855125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e4f73-f229-42d5-8281-dd1be39a0ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:24.855828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4f73-f229-42d5-8281-dd1be39a0ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.856116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4f73-f229-42d5-8281-dd1be39a0ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.856403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4f73-f229-42d5-8281-dd1be39a0ee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.908840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:24.926547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c608-8d88-4ced-8358-beda525c2be4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:24.931366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e4f73-f229-42d5-8281-dd1be39a0ee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:24.932850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e4f73-f229-42d5-8281-dd1be39a0ee5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:24.962780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aed25-eeb1-4356-b56b-0d050c3e30f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:24.963652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aed25-eeb1-4356-b56b-0d050c3e30f4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.963947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aed25-eeb1-4356-b56b-0d050c3e30f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.964228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aed25-eeb1-4356-b56b-0d050c3e30f4 None admin] PATH_INFO: `/v3/projects/6e2129a17373485f8b5c57afb0be10aa` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.965411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8aed25-eeb1-4356-b56b-0d050c3e30f4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e2129a17373485f8b5c57afb0be10aa)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:24.966896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8aed25-eeb1-4356-b56b-0d050c3e30f4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:24.968618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 536/1068] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:24 2022] GET /identity/v3/projects/6e2129a17373485f8b5c57afb0be10aa => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:24.970472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4248-4e80-4991-90c0-f8c9565c7f8e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:24.970763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4248-4e80-4991-90c0-f8c9565c7f8e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:24.971044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4248-4e80-4991-90c0-f8c9565c7f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:24.987640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5f0c4248-4e80-4991-90c0-f8c9565c7f8e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:24.988846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5f0c4248-4e80-4991-90c0-f8c9565c7f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:25.035904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 533/1069] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:47:25.036797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e4f73-f229-42d5-8281-dd1be39a0ee5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:25.038746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:25.062292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 537/1070] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:25.063646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c4248-4e80-4991-90c0-f8c9565c7f8e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:25.127965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:25.147351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e4f73-f229-42d5-8281-dd1be39a0ee5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:25.177153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c4248-4e80-4991-90c0-f8c9565c7f8e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:25.183488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0644d-2857-4085-85c9-1e71d5b54427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:25.184392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0644d-2857-4085-85c9-1e71d5b54427 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:25.184678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0644d-2857-4085-85c9-1e71d5b54427 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:25.184969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0644d-2857-4085-85c9-1e71d5b54427 None admin] PATH_INFO: `/v3/projects/6e2129a17373485f8b5c57afb0be10aa/users/61a377867fc4469e94f0715535495cef/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:25.187010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0644d-2857-4085-85c9-1e71d5b54427 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e2129a17373485f8b5c57afb0be10aa, user_id=61a377867fc4469e94f0715535495cef, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:25.188563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0644d-2857-4085-85c9-1e71d5b54427 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:25.201685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 534/1071] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:47:25 2022] PUT /identity/v3/projects/6e2129a17373485f8b5c57afb0be10aa/users/61a377867fc4469e94f0715535495cef/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:47:25.202523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0644d-2857-4085-85c9-1e71d5b54427 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:25.214356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:25.215196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:25.215485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:25.215767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:25.228276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:25.229811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:25.249344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:25.250416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:25.251316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:25.251316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:25.251316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:25.251316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:25.251316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 538/1072] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:25.256865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:25.299489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:25.371161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0644d-2857-4085-85c9-1e71d5b54427 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:25.385863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780f9e-c5e0-41db-b9db-aab74dd4f93e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:25.428049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a4142-dc74-4af9-b484-b5b1c7bf6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:25.428882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a4142-dc74-4af9-b484-b5b1c7bf6228 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:25.429169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a4142-dc74-4af9-b484-b5b1c7bf6228 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:25.429450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a4142-dc74-4af9-b484-b5b1c7bf6228 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:25.441965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a4142-dc74-4af9-b484-b5b1c7bf6228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:25.443776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:25.444456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:25.444740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:25.445019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:25.445854 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:25.446167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:25.447735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-095a4142-dc74-4af9-b484-b5b1c7bf6228 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:25.450329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:25.451300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:25.452143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 535/1073] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 8 12:47:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:25.458100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a4142-dc74-4af9-b484-b5b1c7bf6228 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:25.461227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:25.464216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 539/1074] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:25.600036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a4142-dc74-4af9-b484-b5b1c7bf6228 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:25.639646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:25.640255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:25.640549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:25.640835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:25.642681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:25.642998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:25.644404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:25.654054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 536/1075] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 8 12:47:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:25.660126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:25.768120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:25.779410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51366d-87ca-4012-828c-7007794f06b8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:25.816666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:25.817473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:25.817860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:25.818145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:25.830248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:25.831727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:25.849857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:25.850935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:25.852123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:25.852123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:25.852123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:25.852123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:25.852123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 540/1076] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:25.857681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:25.918489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:25.963738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdceb2ae-a981-434d-8407-40c2405ffd0b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:26.010046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:26.011201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:26.011699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:26.012161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:26.013415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:26.013943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:26.015867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:26.029852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 537/1077] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:26.037511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:26.159975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619c2d9-b4e2-4af9-a37d-cbdb36985e0f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:26.196256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:26.196975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:26.197268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:26.197577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:26.206337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:26.207910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:47:26.223775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:26.224927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:26.226221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 541/1078] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:47:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:26.230821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:26.347805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d197-64ee-4d3b-a85f-772df4b73956 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:26.380945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:26.400749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:26.401478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:26.401807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:26.402089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:26.403383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:26.403705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:26.405234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:26.426559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 538/1079] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:47:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:26.432101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:26.441816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:26.537465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ffc79-e16b-4284-82b5-f99e2a49d820 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:26.572295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:26.573107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:26.573398 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:26.573712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:26.586015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:26.587503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:26.605629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:26.606739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:26.607798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:26.607798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:26.607798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:26.607798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:26.607798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 542/1080] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:26.612972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:26.713671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aabbc3-82fc-49a7-9fdf-3a327cbdaf66 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:26.747762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:26.748432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:26.748720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:26.749002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:26.749768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:26.750081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:26.751711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:26.763069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 539/1081] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:26.769448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:26.832009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:26.877536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dff027-8081-44e2-9768-c0f69dba1b39 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:26.912266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:26.913075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:26.913362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:26.913674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:26.920873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:26.922968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:47:26.939181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:26.940198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:26.941124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 543/1082] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:47:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:26.946458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:26.992126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:27.051559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cba54-1dfb-41da-a850-64474f6939ea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:27.088383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309dd54-d74c-43a8-94a9-bb6dd39354cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:27.088960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309dd54-d74c-43a8-94a9-bb6dd39354cb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:27.089242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309dd54-d74c-43a8-94a9-bb6dd39354cb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:27.089521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309dd54-d74c-43a8-94a9-bb6dd39354cb None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:27.090338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309dd54-d74c-43a8-94a9-bb6dd39354cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:27.090653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309dd54-d74c-43a8-94a9-bb6dd39354cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:27.092086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309dd54-d74c-43a8-94a9-bb6dd39354cb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:27.104965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 540/1083] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:47:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:27.111111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:27.214245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f527-ab56-496e-a43d-673bac71e708 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:27.233678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:27.254266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7d12-9f46-4f89-95be-7cbe56e97841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:27.255196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7d12-9f46-4f89-95be-7cbe56e97841 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:27.255486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7d12-9f46-4f89-95be-7cbe56e97841 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:27.255772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7d12-9f46-4f89-95be-7cbe56e97841 None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/63fe1877e3334a29b3bdfa0ba22174da/roles/8d3f37f77181497091cc4fb28137dde6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:27.258643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7d12-9f46-4f89-95be-7cbe56e97841 None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=63fe1877e3334a29b3bdfa0ba22174da, role_id=8d3f37f77181497091cc4fb28137dde6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:27.260195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7d12-9f46-4f89-95be-7cbe56e97841 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:27.280726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 544/1084] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:47:27 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/63fe1877e3334a29b3bdfa0ba22174da/roles/8d3f37f77181497091cc4fb28137dde6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:47:27.574824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466973-85c8-4510-9471-5200b5ba509b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:27.575345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466973-85c8-4510-9471-5200b5ba509b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:27.575437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466973-85c8-4510-9471-5200b5ba509b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:27.576758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 541/1085] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:27.582263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746117b4-7dfb-4ee3-ae4d-f7ca53aa7778 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:27.582561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746117b4-7dfb-4ee3-ae4d-f7ca53aa7778 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:27.582877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746117b4-7dfb-4ee3-ae4d-f7ca53aa7778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:27.599970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-746117b4-7dfb-4ee3-ae4d-f7ca53aa7778 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:27.601164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-746117b4-7dfb-4ee3-ae4d-f7ca53aa7778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:27.680586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 545/1086] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:27.709048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466973-85c8-4510-9471-5200b5ba509b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:27.854933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466973-85c8-4510-9471-5200b5ba509b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:27.857716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:27.907537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d0f4-e1ea-4ba3-b279-2a47c353ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:27.908604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d0f4-e1ea-4ba3-b279-2a47c353ed04 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:27.909073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d0f4-e1ea-4ba3-b279-2a47c353ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:27.909364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d0f4-e1ea-4ba3-b279-2a47c353ed04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:27.923698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957d0f4-e1ea-4ba3-b279-2a47c353ed04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2957d0f4-e1ea-4ba3-b279-2a47c353ed04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:27.932125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:27.934131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:27.936094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 542/1087] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:47:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:27.941317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746117b4-7dfb-4ee3-ae4d-f7ca53aa7778 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:28.046634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746117b4-7dfb-4ee3-ae4d-f7ca53aa7778 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:28.057270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:28.084512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:28.085194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:28.085486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:28.085803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:28.086569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:28.086967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:28.088274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:28.099439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 546/1088] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:47:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:28.107475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d0f4-e1ea-4ba3-b279-2a47c353ed04 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:28.276758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d0f4-e1ea-4ba3-b279-2a47c353ed04 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:28.331069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a1899-53f0-490b-9278-3f9d046f7191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:28.332573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a1899-53f0-490b-9278-3f9d046f7191 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:28.333069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a1899-53f0-490b-9278-3f9d046f7191 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:28.333516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a1899-53f0-490b-9278-3f9d046f7191 None admin] PATH_INFO: `/v3/users/61a377867fc4469e94f0715535495cef` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:28.335526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a1899-53f0-490b-9278-3f9d046f7191 None admin] RBAC: Authorizing `identity:get_user(user_id=61a377867fc4469e94f0715535495cef)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:28.338196 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a1899-53f0-490b-9278-3f9d046f7191 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:28.341279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 543/1089] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:28 2022] GET /identity/v3/users/61a377867fc4469e94f0715535495cef => generated 285 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:28.347741 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:28.468546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068cf39-e409-4ca0-86a0-1866a064840b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:28.507731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8937-b683-40f9-816a-f1ac3dcbd0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:28.508380 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8937-b683-40f9-816a-f1ac3dcbd0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:28.508670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8937-b683-40f9-816a-f1ac3dcbd0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:28.508950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8937-b683-40f9-816a-f1ac3dcbd0d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:28.552853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:28.582726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c8937-b683-40f9-816a-f1ac3dcbd0d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:28.584443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c8937-b683-40f9-816a-f1ac3dcbd0d3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:28.689980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 547/1090] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:47:28.695771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a1899-53f0-490b-9278-3f9d046f7191 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:28.728080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:28.803178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a1899-53f0-490b-9278-3f9d046f7191 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:28.836805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32fde-d2c5-404c-b3bd-8b3977d971c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:28.837702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32fde-d2c5-404c-b3bd-8b3977d971c4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:28.837989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32fde-d2c5-404c-b3bd-8b3977d971c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:28.838269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32fde-d2c5-404c-b3bd-8b3977d971c4 None admin] PATH_INFO: `/v3/projects/6e2129a17373485f8b5c57afb0be10aa` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:28.839439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b32fde-d2c5-404c-b3bd-8b3977d971c4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e2129a17373485f8b5c57afb0be10aa)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:28.840856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b32fde-d2c5-404c-b3bd-8b3977d971c4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:28.842592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 544/1091] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:28 2022] GET /identity/v3/projects/6e2129a17373485f8b5c57afb0be10aa => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:28.848658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8937-b683-40f9-816a-f1ac3dcbd0d3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:28.926285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:28.959709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8937-b683-40f9-816a-f1ac3dcbd0d3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:28.995795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a46e7-1196-4be4-a714-64e4573c9b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:28.996463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a46e7-1196-4be4-a714-64e4573c9b12 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:28.996756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a46e7-1196-4be4-a714-64e4573c9b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:28.997043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a46e7-1196-4be4-a714-64e4573c9b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:28.997932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a46e7-1196-4be4-a714-64e4573c9b12 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=6e2129a17373485f8b5c57afb0be10aa, user.id=61a377867fc4469e94f0715535495cef) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:28.998255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a46e7-1196-4be4-a714-64e4573c9b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:28.999703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a46e7-1196-4be4-a714-64e4573c9b12 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:29.006459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 548/1092] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:28 2022] GET /identity/v3/role_assignments?user.id=61a377867fc4469e94f0715535495cef&scope.project.id=6e2129a17373485f8b5c57afb0be10aa&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:29.675158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8956a-eaa9-4cd1-83dc-728fe02e2a2d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:29.675510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8956a-eaa9-4cd1-83dc-728fe02e2a2d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:29.675884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8956a-eaa9-4cd1-83dc-728fe02e2a2d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:29.677368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 545/1093] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:29.682817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6e73c-13fb-4834-b6bd-4c3af6943753 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:29.683258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6e73c-13fb-4834-b6bd-4c3af6943753 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:29.683384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6e73c-13fb-4834-b6bd-4c3af6943753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:29.700988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-38a6e73c-13fb-4834-b6bd-4c3af6943753 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:29.702221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-38a6e73c-13fb-4834-b6bd-4c3af6943753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:29.773281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 549/1094] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:29.798421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8956a-eaa9-4cd1-83dc-728fe02e2a2d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:29.917728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:29.923834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8956a-eaa9-4cd1-83dc-728fe02e2a2d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:29.959743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc29d7e-8429-4fb9-9de9-ff4801e49b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:29.960475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc29d7e-8429-4fb9-9de9-ff4801e49b62 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:29.960764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc29d7e-8429-4fb9-9de9-ff4801e49b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:29.961044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc29d7e-8429-4fb9-9de9-ff4801e49b62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:29.972429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc29d7e-8429-4fb9-9de9-ff4801e49b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cfc29d7e-8429-4fb9-9de9-ff4801e49b62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:29.982325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:29.983344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:29.984217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 546/1095] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 8 12:47:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:29.990758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6e73c-13fb-4834-b6bd-4c3af6943753 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:30.068436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:30.108686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6e73c-13fb-4834-b6bd-4c3af6943753 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:30.166115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:30.166810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:30.167103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:30.167387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:30.168150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:30.168464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:30.169881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:30.180402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 550/1096] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 8 12:47:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:30.186296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc29d7e-8429-4fb9-9de9-ff4801e49b62 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:30.293962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc29d7e-8429-4fb9-9de9-ff4801e49b62 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:30.327727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:30.329217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:30.329499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:30.329862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:30.340409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:30.341878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:30.360283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:30.361274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:30.362225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:30.362225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:30.362225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:30.362225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:30.362225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 547/1097] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:30.367511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:30.479940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1dabb-7beb-4f08-ba16-bc9caf17c7b4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:30.510744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:30.520946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:30.521637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:30.521926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:30.522207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:30.522931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:30.523239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:30.524600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:30.537129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 551/1098] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:30.542719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:30.555355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:30.643894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b614776-9927-4013-b463-cbf2f64251ab None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:30.678499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:30.679309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:30.679595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:30.679873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:30.687188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:30.689298 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:47:30.705885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:30.707076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:30.708108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 548/1099] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 8 12:47:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:30.713003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:30.823444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b5eaa-26dc-4865-ae10-bf484bbd4661 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:30.858527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:30.859211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:30.860067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:30.860365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:30.861308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:30.861718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:30.863186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:30.881321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 552/1100] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 8 12:47:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:30.886908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:30.964723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:30.997949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06645972-c320-4a3e-b0f9-bf2a659ab980 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:31.033474 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d53105-857f-4a04-9b23-476ed07e43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:31.034168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53105-857f-4a04-9b23-476ed07e43aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:31.034459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53105-857f-4a04-9b23-476ed07e43aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:31.034745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53105-857f-4a04-9b23-476ed07e43aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:31.110099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d53105-857f-4a04-9b23-476ed07e43aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:31.111473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d53105-857f-4a04-9b23-476ed07e43aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:31.190743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:31.225980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 549/1101] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 12:47:31.231907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:31.280893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:31.344445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ac9fb-2911-4007-a32d-cddf887757b8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:31.384531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:31.385271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:31.385578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:31.385865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:31.400602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:31.402130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:31.420782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be71672-bb97-4196-9a26-53b33132ba6a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:31.421080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be71672-bb97-4196-9a26-53b33132ba6a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:31.421369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be71672-bb97-4196-9a26-53b33132ba6a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:47:31.421472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:31.422552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:31.423613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:47:31.423613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:47:31.423613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:47:31.423613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:31.423851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 550/1102] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:47:31.423923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 553/1103] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:31.428715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c69ca4-88ef-4b01-9536-9fa27437985a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:31.429190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c69ca4-88ef-4b01-9536-9fa27437985a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:31.429357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c69ca4-88ef-4b01-9536-9fa27437985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:31.430085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:31.450184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-94c69ca4-88ef-4b01-9536-9fa27437985a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:31.451402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-94c69ca4-88ef-4b01-9536-9fa27437985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:31.537589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 551/1104] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:47:31.541811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:31.550468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db971b17-811c-4e9b-9856-923c252f6932 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:31.566479 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c69ca4-88ef-4b01-9536-9fa27437985a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:31.597651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:31.598456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:31.598852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:31.599297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:31.600204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:31.600527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:31.601965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:31.614200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 554/1105] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:31.619924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:31.666144 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:31.669561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c69ca4-88ef-4b01-9536-9fa27437985a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:31.706226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51560050-8161-4e38-bc87-ce1f912df5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:31.707019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51560050-8161-4e38-bc87-ce1f912df5dc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:31.707301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51560050-8161-4e38-bc87-ce1f912df5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:31.707577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51560050-8161-4e38-bc87-ce1f912df5dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:31.708886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51560050-8161-4e38-bc87-ce1f912df5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:31.710354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51560050-8161-4e38-bc87-ce1f912df5dc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:31.711997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 552/1106] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:31.717579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51560050-8161-4e38-bc87-ce1f912df5dc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:31.740165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231ad82-96f3-4cba-a94e-6a8b7419b1ac None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:31.782046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:31.783290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:31.783753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:31.784203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:31.792676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:31.794200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:47:31.813722 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:31.814842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:31.815768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 555/1107] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:47:31.822244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:31.837863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51560050-8161-4e38-bc87-ce1f912df5dc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:31.849468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:31.885350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436be2a-47dc-4056-a2f5-02421385a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:31.886068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436be2a-47dc-4056-a2f5-02421385a430 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:31.886356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436be2a-47dc-4056-a2f5-02421385a430 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:31.886657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436be2a-47dc-4056-a2f5-02421385a430 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:31.887366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436be2a-47dc-4056-a2f5-02421385a430 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:31.888813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436be2a-47dc-4056-a2f5-02421385a430 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:31.913463 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 553/1108] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:47:31 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:47:31.975616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6ed35-e8f6-4e94-b7e5-550c1908599f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:32.028399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deabb8-05ba-441b-8b4e-3db35c4f419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:32.029160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deabb8-05ba-441b-8b4e-3db35c4f419f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:32.029455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deabb8-05ba-441b-8b4e-3db35c4f419f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:32.029802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deabb8-05ba-441b-8b4e-3db35c4f419f None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:32.031361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8deabb8-05ba-441b-8b4e-3db35c4f419f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:32.032377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8deabb8-05ba-441b-8b4e-3db35c4f419f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:32.034824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8deabb8-05ba-441b-8b4e-3db35c4f419f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:32.051532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 556/1109] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:47:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:32.058229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436be2a-47dc-4056-a2f5-02421385a430 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:32.090733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:32.189766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436be2a-47dc-4056-a2f5-02421385a430 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:32.236472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90154-1d96-4806-93e4-b0f889f71cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:32.237492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90154-1d96-4806-93e4-b0f889f71cec None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:32.238024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90154-1d96-4806-93e4-b0f889f71cec None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:32.238528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90154-1d96-4806-93e4-b0f889f71cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:32.239872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90154-1d96-4806-93e4-b0f889f71cec None admin] RBAC: Adding query filter params (role.id=8d3f37f77181497091cc4fb28137dde6, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=63fe1877e3334a29b3bdfa0ba22174da) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:32.240200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90154-1d96-4806-93e4-b0f889f71cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:32.241979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90154-1d96-4806-93e4-b0f889f71cec None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:32.248881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 554/1110] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:32 2022] GET /identity/v3/role_assignments?user.id=63fe1877e3334a29b3bdfa0ba22174da&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=8d3f37f77181497091cc4fb28137dde6 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:34.326355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86be8a-4094-4965-bcc0-ae5ede2081a5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:34.326930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86be8a-4094-4965-bcc0-ae5ede2081a5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:34.326930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86be8a-4094-4965-bcc0-ae5ede2081a5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:34.328996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 557/1111] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:34.334658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b57c3-193d-4dce-93f7-8e7127298776 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:34.335122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b57c3-193d-4dce-93f7-8e7127298776 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:34.335242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b57c3-193d-4dce-93f7-8e7127298776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:34.353570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-265b57c3-193d-4dce-93f7-8e7127298776 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:34.354807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-265b57c3-193d-4dce-93f7-8e7127298776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:34.422932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 555/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:34.447316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86be8a-4094-4965-bcc0-ae5ede2081a5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:34.528377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:34.557424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86be8a-4094-4965-bcc0-ae5ede2081a5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:34.592948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534e65a-5fe6-40c6-b3bf-4d307954c0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:34.593813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534e65a-5fe6-40c6-b3bf-4d307954c0bd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:34.594080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534e65a-5fe6-40c6-b3bf-4d307954c0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:34.594365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534e65a-5fe6-40c6-b3bf-4d307954c0bd None admin] PATH_INFO: `/v3/roles/025cadb68d6641098d3edb9e47910aaf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:34.595885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534e65a-5fe6-40c6-b3bf-4d307954c0bd None admin] RBAC: Authorizing `identity:get_role(role_id=025cadb68d6641098d3edb9e47910aaf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:34.597277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534e65a-5fe6-40c6-b3bf-4d307954c0bd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:34.598708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 558/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:34 2022] GET /identity/v3/roles/025cadb68d6641098d3edb9e47910aaf => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:34.604560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b57c3-193d-4dce-93f7-8e7127298776 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:34.623311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:34.706108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b57c3-193d-4dce-93f7-8e7127298776 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:34.740709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee34d1-ce95-4bd2-9355-564bd37f463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:34.741889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee34d1-ce95-4bd2-9355-564bd37f463f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:34.742178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee34d1-ce95-4bd2-9355-564bd37f463f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:34.742457 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee34d1-ce95-4bd2-9355-564bd37f463f None admin] PATH_INFO: `/v3/users/f926134190ed40afa68d1c8f5855200e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:34.757419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee34d1-ce95-4bd2-9355-564bd37f463f None admin] RBAC: Authorizing `identity:get_user(user_id=f926134190ed40afa68d1c8f5855200e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:34.758911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee34d1-ce95-4bd2-9355-564bd37f463f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:34.760679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 556/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:34 2022] GET /identity/v3/users/f926134190ed40afa68d1c8f5855200e => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:34.766550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534e65a-5fe6-40c6-b3bf-4d307954c0bd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:34.880315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534e65a-5fe6-40c6-b3bf-4d307954c0bd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:34.914072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382afb54-8646-406b-9e3a-d46c7bb024a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:34.914741 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afb54-8646-406b-9e3a-d46c7bb024a8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:34.915033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afb54-8646-406b-9e3a-d46c7bb024a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:34.915316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afb54-8646-406b-9e3a-d46c7bb024a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:34.931788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:34.989191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382afb54-8646-406b-9e3a-d46c7bb024a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:34.991104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382afb54-8646-406b-9e3a-d46c7bb024a8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:35.103909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 559/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:47:35.110613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee34d1-ce95-4bd2-9355-564bd37f463f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:35.191728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:35.216339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee34d1-ce95-4bd2-9355-564bd37f463f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:35.253268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3e9f2-99cb-49a2-874e-e344e337c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:35.254169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e9f2-99cb-49a2-874e-e344e337c26b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:35.254461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e9f2-99cb-49a2-874e-e344e337c26b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:35.254746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e9f2-99cb-49a2-874e-e344e337c26b None admin] PATH_INFO: `/v3/projects/6e2129a17373485f8b5c57afb0be10aa` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:35.255962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3e9f2-99cb-49a2-874e-e344e337c26b None admin] RBAC: Authorizing `identity:get_project(project_id=6e2129a17373485f8b5c57afb0be10aa)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:35.257428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3e9f2-99cb-49a2-874e-e344e337c26b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:35.259223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 557/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:35 2022] GET /identity/v3/projects/6e2129a17373485f8b5c57afb0be10aa => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:35.265438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382afb54-8646-406b-9e3a-d46c7bb024a8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:35.316676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:35.371964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382afb54-8646-406b-9e3a-d46c7bb024a8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:35.408217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d68b5-b25b-4730-936c-1fc75aa7da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:35.408894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d68b5-b25b-4730-936c-1fc75aa7da7a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:35.409183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d68b5-b25b-4730-936c-1fc75aa7da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:35.409468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d68b5-b25b-4730-936c-1fc75aa7da7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:35.410374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d68b5-b25b-4730-936c-1fc75aa7da7a None admin] RBAC: Adding query filter params (role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=6e2129a17373485f8b5c57afb0be10aa, user.id=f926134190ed40afa68d1c8f5855200e) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:35.410696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d68b5-b25b-4730-936c-1fc75aa7da7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:35.412156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d68b5-b25b-4730-936c-1fc75aa7da7a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:35.419043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 560/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:35 2022] GET /identity/v3/role_assignments?user.id=f926134190ed40afa68d1c8f5855200e&scope.project.id=6e2129a17373485f8b5c57afb0be10aa&role.id=025cadb68d6641098d3edb9e47910aaf => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:37.752066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e9fb-6830-4c4f-a871-747d1f657c4a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:37.752590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e9fb-6830-4c4f-a871-747d1f657c4a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:37.752590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e9fb-6830-4c4f-a871-747d1f657c4a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:37.753977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 558/1118] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:37.759832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299012-b313-4465-b7ff-08f49ccd028d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:37.760384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299012-b313-4465-b7ff-08f49ccd028d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:37.760384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299012-b313-4465-b7ff-08f49ccd028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:37.779029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ef299012-b313-4465-b7ff-08f49ccd028d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:37.780259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ef299012-b313-4465-b7ff-08f49ccd028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:37.863551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 561/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:37.887279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e9fb-6830-4c4f-a871-747d1f657c4a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:38.004103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e9fb-6830-4c4f-a871-747d1f657c4a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:38.046934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e382b-52e2-4d3e-af3c-2dcfba37129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:38.047834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e382b-52e2-4d3e-af3c-2dcfba37129e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:38.048121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e382b-52e2-4d3e-af3c-2dcfba37129e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:38.048405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e382b-52e2-4d3e-af3c-2dcfba37129e None admin] PATH_INFO: `/v3/roles/025cadb68d6641098d3edb9e47910aaf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:38.050061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e382b-52e2-4d3e-af3c-2dcfba37129e None admin] RBAC: Authorizing `identity:get_role(role_id=025cadb68d6641098d3edb9e47910aaf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:38.051475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e382b-52e2-4d3e-af3c-2dcfba37129e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:38.053096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 559/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:37 2022] GET /identity/v3/roles/025cadb68d6641098d3edb9e47910aaf => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:38.059676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef299012-b313-4465-b7ff-08f49ccd028d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:38.111032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:38.177911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef299012-b313-4465-b7ff-08f49ccd028d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:38.214010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a709f-ffe0-43d8-955d-13bbf4200400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:38.214907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a709f-ffe0-43d8-955d-13bbf4200400 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:38.215197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a709f-ffe0-43d8-955d-13bbf4200400 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:38.215480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a709f-ffe0-43d8-955d-13bbf4200400 None admin] PATH_INFO: `/v3/users/f926134190ed40afa68d1c8f5855200e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:38.216717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a709f-ffe0-43d8-955d-13bbf4200400 None admin] RBAC: Authorizing `identity:get_user(user_id=f926134190ed40afa68d1c8f5855200e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:38.218213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a709f-ffe0-43d8-955d-13bbf4200400 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:38.220172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 562/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:38 2022] GET /identity/v3/users/f926134190ed40afa68d1c8f5855200e => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:38.226659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e382b-52e2-4d3e-af3c-2dcfba37129e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:38.244275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:38.341781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e382b-52e2-4d3e-af3c-2dcfba37129e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:38.382773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a906cc-1c69-46cf-becd-297a148c887e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:38.383641 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a906cc-1c69-46cf-becd-297a148c887e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:38.383924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a906cc-1c69-46cf-becd-297a148c887e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:38.384199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a906cc-1c69-46cf-becd-297a148c887e None admin] PATH_INFO: `/v3/projects/6e2129a17373485f8b5c57afb0be10aa` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:38.385427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a906cc-1c69-46cf-becd-297a148c887e None admin] RBAC: Authorizing `identity:get_project(project_id=6e2129a17373485f8b5c57afb0be10aa)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:38.386910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a906cc-1c69-46cf-becd-297a148c887e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:38.388644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 560/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:38 2022] GET /identity/v3/projects/6e2129a17373485f8b5c57afb0be10aa => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:38.395520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a709f-ffe0-43d8-955d-13bbf4200400 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:38.512020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a709f-ffe0-43d8-955d-13bbf4200400 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:38.520921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:38.551885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5504-30ec-4073-b7c2-e773cc7cbcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:38.552806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5504-30ec-4073-b7c2-e773cc7cbcaf None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:38.553093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5504-30ec-4073-b7c2-e773cc7cbcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:38.553374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5504-30ec-4073-b7c2-e773cc7cbcaf None admin] PATH_INFO: `/v3/projects/6e2129a17373485f8b5c57afb0be10aa/users/f926134190ed40afa68d1c8f5855200e/roles/025cadb68d6641098d3edb9e47910aaf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:38.555731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c5504-30ec-4073-b7c2-e773cc7cbcaf None admin] RBAC: Authorizing `identity:create_grant(project_id=6e2129a17373485f8b5c57afb0be10aa, user_id=f926134190ed40afa68d1c8f5855200e, role_id=025cadb68d6641098d3edb9e47910aaf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:38.557284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c5504-30ec-4073-b7c2-e773cc7cbcaf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:38.572795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 563/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:47:38 2022] PUT /identity/v3/projects/6e2129a17373485f8b5c57afb0be10aa/users/f926134190ed40afa68d1c8f5855200e/roles/025cadb68d6641098d3edb9e47910aaf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:47:40.968063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82c703-38c6-4b59-bc60-2ee8cac54eb8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:40.968776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82c703-38c6-4b59-bc60-2ee8cac54eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:40.968776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82c703-38c6-4b59-bc60-2ee8cac54eb8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:40.971175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 561/1124] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:40.977367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850067a-a037-4a91-8a40-91ab1490bd9a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:40.978032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850067a-a037-4a91-8a40-91ab1490bd9a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:40.978032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850067a-a037-4a91-8a40-91ab1490bd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:40.996193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a850067a-a037-4a91-8a40-91ab1490bd9a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:40.997438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a850067a-a037-4a91-8a40-91ab1490bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:41.072277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 564/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:41.097819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82c703-38c6-4b59-bc60-2ee8cac54eb8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:41.192180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:41.213705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82c703-38c6-4b59-bc60-2ee8cac54eb8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:41.254073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e6bd-4237-49cb-ac65-4612f11e250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:41.254853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e6bd-4237-49cb-ac65-4612f11e250f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:41.255138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e6bd-4237-49cb-ac65-4612f11e250f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:41.255428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e6bd-4237-49cb-ac65-4612f11e250f None admin] PATH_INFO: `/v3/roles/025cadb68d6641098d3edb9e47910aaf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:41.256978 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e6bd-4237-49cb-ac65-4612f11e250f None admin] RBAC: Authorizing `identity:get_role(role_id=025cadb68d6641098d3edb9e47910aaf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:41.258393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e6bd-4237-49cb-ac65-4612f11e250f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:41.259810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 562/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:41 2022] GET /identity/v3/roles/025cadb68d6641098d3edb9e47910aaf => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:41.265727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850067a-a037-4a91-8a40-91ab1490bd9a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:41.366763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:41.373867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850067a-a037-4a91-8a40-91ab1490bd9a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:41.413035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dadaac-f188-45ba-82f4-6d3864b816d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:41.413980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadaac-f188-45ba-82f4-6d3864b816d4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:41.414273 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadaac-f188-45ba-82f4-6d3864b816d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:41.414560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadaac-f188-45ba-82f4-6d3864b816d4 None admin] PATH_INFO: `/v3/users/f926134190ed40afa68d1c8f5855200e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:41.415892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dadaac-f188-45ba-82f4-6d3864b816d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f926134190ed40afa68d1c8f5855200e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:41.417387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dadaac-f188-45ba-82f4-6d3864b816d4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:41.419168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 565/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:41 2022] GET /identity/v3/users/f926134190ed40afa68d1c8f5855200e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:41.425843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e6bd-4237-49cb-ac65-4612f11e250f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:41.542321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e6bd-4237-49cb-ac65-4612f11e250f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:41.581005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d8b7-a643-40f8-99f5-f2060efdb245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:41.581784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d8b7-a643-40f8-99f5-f2060efdb245 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:41.582077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d8b7-a643-40f8-99f5-f2060efdb245 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:41.582362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d8b7-a643-40f8-99f5-f2060efdb245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:41.603817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:41.664058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86d8b7-a643-40f8-99f5-f2060efdb245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:41.667395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86d8b7-a643-40f8-99f5-f2060efdb245 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:41.798730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 563/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:47:41.804618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dadaac-f188-45ba-82f4-6d3864b816d4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:41.913456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dadaac-f188-45ba-82f4-6d3864b816d4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:41.950526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f04cd-755c-4597-a103-07b62cad2948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:41.951403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f04cd-755c-4597-a103-07b62cad2948 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:41.951685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f04cd-755c-4597-a103-07b62cad2948 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:41.951961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f04cd-755c-4597-a103-07b62cad2948 None admin] PATH_INFO: `/v3/projects/6e2129a17373485f8b5c57afb0be10aa` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:41.954449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f04cd-755c-4597-a103-07b62cad2948 None admin] RBAC: Authorizing `identity:get_project(project_id=6e2129a17373485f8b5c57afb0be10aa)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:41.958606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f04cd-755c-4597-a103-07b62cad2948 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:41.961782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 566/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:41 2022] GET /identity/v3/projects/6e2129a17373485f8b5c57afb0be10aa => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:41.968048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d8b7-a643-40f8-99f5-f2060efdb245 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:42.027166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:42.092573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d8b7-a643-40f8-99f5-f2060efdb245 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:42.128960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332d84a-594e-421b-8c94-58f8f1431dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:42.129652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d84a-594e-421b-8c94-58f8f1431dcf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:42.129947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d84a-594e-421b-8c94-58f8f1431dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:42.130230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d84a-594e-421b-8c94-58f8f1431dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:42.131086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d84a-594e-421b-8c94-58f8f1431dcf None admin] RBAC: Adding query filter params (role.id=025cadb68d6641098d3edb9e47910aaf, scope.project.id=6e2129a17373485f8b5c57afb0be10aa, user.id=f926134190ed40afa68d1c8f5855200e) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:42.131404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d84a-594e-421b-8c94-58f8f1431dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:42.132858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d84a-594e-421b-8c94-58f8f1431dcf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:42.139599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 564/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:41 2022] GET /identity/v3/role_assignments?user.id=f926134190ed40afa68d1c8f5855200e&scope.project.id=6e2129a17373485f8b5c57afb0be10aa&role.id=025cadb68d6641098d3edb9e47910aaf => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:44.460143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1af95-d477-490d-a347-9b4660e2a6a1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:44.460706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1af95-d477-490d-a347-9b4660e2a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:44.460706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1af95-d477-490d-a347-9b4660e2a6a1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:44.462111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 567/1131] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:44.467642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373dd98-5b89-4a85-8a80-f57840a9dbf8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:44.468112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373dd98-5b89-4a85-8a80-f57840a9dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:44.468112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373dd98-5b89-4a85-8a80-f57840a9dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:44.485690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3373dd98-5b89-4a85-8a80-f57840a9dbf8 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:44.486905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3373dd98-5b89-4a85-8a80-f57840a9dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:44.555733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 565/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:44.580270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1af95-d477-490d-a347-9b4660e2a6a1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:44.613150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:44.686719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1af95-d477-490d-a347-9b4660e2a6a1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:44.722960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90017993-e864-4474-b004-31635bf5bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:44.723768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017993-e864-4474-b004-31635bf5bd8d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:44.724061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017993-e864-4474-b004-31635bf5bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:44.724344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017993-e864-4474-b004-31635bf5bd8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:44.725534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90017993-e864-4474-b004-31635bf5bd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:44.727017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90017993-e864-4474-b004-31635bf5bd8d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:44.728699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 568/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:44.734941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373dd98-5b89-4a85-8a80-f57840a9dbf8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:44.784805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:44.844197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373dd98-5b89-4a85-8a80-f57840a9dbf8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:44.878804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e310ee-5c57-470a-9b6a-c8df77c29ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:44.879473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e310ee-5c57-470a-9b6a-c8df77c29ac7 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:44.879764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e310ee-5c57-470a-9b6a-c8df77c29ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:44.880049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e310ee-5c57-470a-9b6a-c8df77c29ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:44.880778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e310ee-5c57-470a-9b6a-c8df77c29ac7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:44.882275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e310ee-5c57-470a-9b6a-c8df77c29ac7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:44.908844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 566/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:47:44 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:47:47.256492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345dd2a-9e60-4fab-97f0-81b4bca44081 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:47.257058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345dd2a-9e60-4fab-97f0-81b4bca44081 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:47.257155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345dd2a-9e60-4fab-97f0-81b4bca44081 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:47.258506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 569/1135] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:47.263848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad166dd6-05f7-4144-9c66-c4a8614e3124 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:47.264297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad166dd6-05f7-4144-9c66-c4a8614e3124 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:47.264403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad166dd6-05f7-4144-9c66-c4a8614e3124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:47.282656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ad166dd6-05f7-4144-9c66-c4a8614e3124 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:47.283889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ad166dd6-05f7-4144-9c66-c4a8614e3124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:47.352674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 567/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:47.378554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345dd2a-9e60-4fab-97f0-81b4bca44081 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:47.482828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:47.487952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345dd2a-9e60-4fab-97f0-81b4bca44081 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:47.522901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfe939-6c02-48bb-97c8-856a54b50c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:47.523611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe939-6c02-48bb-97c8-856a54b50c97 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:47.523898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe939-6c02-48bb-97c8-856a54b50c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:47.524177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe939-6c02-48bb-97c8-856a54b50c97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:47.525362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfe939-6c02-48bb-97c8-856a54b50c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:47.526837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfe939-6c02-48bb-97c8-856a54b50c97 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:47.528451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 570/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:47:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:47.534379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad166dd6-05f7-4144-9c66-c4a8614e3124 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:47.560221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:47.636438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad166dd6-05f7-4144-9c66-c4a8614e3124 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:47.670191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246ec6c-7524-4222-9964-4d8f3b3782e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:47.670875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246ec6c-7524-4222-9964-4d8f3b3782e1 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:47.671901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246ec6c-7524-4222-9964-4d8f3b3782e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:47.672129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246ec6c-7524-4222-9964-4d8f3b3782e1 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:47.672683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246ec6c-7524-4222-9964-4d8f3b3782e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:47.674201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246ec6c-7524-4222-9964-4d8f3b3782e1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:47.694401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 568/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:47:47 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:47:50.012441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf559792-a479-4e6e-95db-d8ed51f2cdf4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:50.012976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf559792-a479-4e6e-95db-d8ed51f2cdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:50.013064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf559792-a479-4e6e-95db-d8ed51f2cdf4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:50.014427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 571/1139] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:50.020123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae585c-ac23-4617-bddf-8df09e09069a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:50.020616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae585c-ac23-4617-bddf-8df09e09069a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:50.020722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae585c-ac23-4617-bddf-8df09e09069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:50.042508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3bae585c-ac23-4617-bddf-8df09e09069a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:50.043780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3bae585c-ac23-4617-bddf-8df09e09069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:50.112850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 569/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:50.136839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf559792-a479-4e6e-95db-d8ed51f2cdf4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:50.241933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf559792-a479-4e6e-95db-d8ed51f2cdf4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:50.278289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3d46-3db9-49ba-b048-fb7ceb276416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:50.279023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3d46-3db9-49ba-b048-fb7ceb276416 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:50.279315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3d46-3db9-49ba-b048-fb7ceb276416 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:50.279602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3d46-3db9-49ba-b048-fb7ceb276416 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:50.291646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3d46-3db9-49ba-b048-fb7ceb276416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-972c3d46-3db9-49ba-b048-fb7ceb276416 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:50.299313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:50.300527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:50.301437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 572/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:47:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:50.306692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae585c-ac23-4617-bddf-8df09e09069a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:50.320903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:50.413950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae585c-ac23-4617-bddf-8df09e09069a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:50.454729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:50.455400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:50.455689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:50.455969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:50.456725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:50.457036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:50.458441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:50.466869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 570/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:47:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:47:50.472786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3d46-3db9-49ba-b048-fb7ceb276416 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:50.502533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:50.583930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3d46-3db9-49ba-b048-fb7ceb276416 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:50.619716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17804-13b3-4136-b147-8d2c0a016bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:50.620593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17804-13b3-4136-b147-8d2c0a016bbb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:50.620883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17804-13b3-4136-b147-8d2c0a016bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:50.621168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17804-13b3-4136-b147-8d2c0a016bbb None admin] PATH_INFO: `/v3/users/523b95797d194f56ac8828d8bacd63c0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:50.635404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac17804-13b3-4136-b147-8d2c0a016bbb None admin] RBAC: Authorizing `identity:get_user(user_id=523b95797d194f56ac8828d8bacd63c0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:50.636866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac17804-13b3-4136-b147-8d2c0a016bbb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:50.638630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 573/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:50 2022] GET /identity/v3/users/523b95797d194f56ac8828d8bacd63c0 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:50.644458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:50.716407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:50.747271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779fdf0-1c88-4119-9909-9ae7bf70794b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:50.782208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0f25-d475-4e9f-abac-15f87c22310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:50.782868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0f25-d475-4e9f-abac-15f87c22310f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:50.783158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0f25-d475-4e9f-abac-15f87c22310f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:50.783441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0f25-d475-4e9f-abac-15f87c22310f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:50.866737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0f25-d475-4e9f-abac-15f87c22310f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:50.868109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0f25-d475-4e9f-abac-15f87c22310f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:50.935524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:50.970822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 571/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:47:50.976937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17804-13b3-4136-b147-8d2c0a016bbb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:51.064389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:51.080339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17804-13b3-4136-b147-8d2c0a016bbb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:51.116703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b733f-0ac2-4e0c-afd0-d638dc16cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:51.117651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b733f-0ac2-4e0c-afd0-d638dc16cd33 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:51.117893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b733f-0ac2-4e0c-afd0-d638dc16cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:51.118175 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b733f-0ac2-4e0c-afd0-d638dc16cd33 None admin] PATH_INFO: `/v3/projects/40310c857efe4f678f579abd6e131d66` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:51.119388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b733f-0ac2-4e0c-afd0-d638dc16cd33 None admin] RBAC: Authorizing `identity:get_project(project_id=40310c857efe4f678f579abd6e131d66)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:51.120843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b733f-0ac2-4e0c-afd0-d638dc16cd33 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:51.122590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 574/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:50 2022] GET /identity/v3/projects/40310c857efe4f678f579abd6e131d66 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:51.129280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0f25-d475-4e9f-abac-15f87c22310f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:51.235216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0f25-d475-4e9f-abac-15f87c22310f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:51.271143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8ae05-02c1-4024-9512-0b08e43f5715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:51.271835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8ae05-02c1-4024-9512-0b08e43f5715 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:51.272131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8ae05-02c1-4024-9512-0b08e43f5715 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:51.272414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8ae05-02c1-4024-9512-0b08e43f5715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:51.273259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8ae05-02c1-4024-9512-0b08e43f5715 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=40310c857efe4f678f579abd6e131d66, user.id=523b95797d194f56ac8828d8bacd63c0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:51.273602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8ae05-02c1-4024-9512-0b08e43f5715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:51.275044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8ae05-02c1-4024-9512-0b08e43f5715 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:51.281623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 572/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:51 2022] GET /identity/v3/role_assignments?user.id=523b95797d194f56ac8828d8bacd63c0&scope.project.id=40310c857efe4f678f579abd6e131d66&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:53.587915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0ab23-0acc-4cc7-8e41-470bc7258e3c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:53.588473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0ab23-0acc-4cc7-8e41-470bc7258e3c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:53.588473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0ab23-0acc-4cc7-8e41-470bc7258e3c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:53.589917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 575/1147] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:53.596054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181c2c-7e65-4ae3-99a1-1726eab31f48 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:53.596527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181c2c-7e65-4ae3-99a1-1726eab31f48 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:53.596633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181c2c-7e65-4ae3-99a1-1726eab31f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:53.613449 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-66181c2c-7e65-4ae3-99a1-1726eab31f48 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:53.614675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-66181c2c-7e65-4ae3-99a1-1726eab31f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:53.644424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:53.683465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 573/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:53.708699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0ab23-0acc-4cc7-8e41-470bc7258e3c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:53.818821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0ab23-0acc-4cc7-8e41-470bc7258e3c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:53.852895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b56d1-2223-4594-b490-7655cfd6e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:53.853784 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b56d1-2223-4594-b490-7655cfd6e856 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:53.854077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b56d1-2223-4594-b490-7655cfd6e856 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:53.854359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b56d1-2223-4594-b490-7655cfd6e856 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:53.865078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b56d1-2223-4594-b490-7655cfd6e856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a90b56d1-2223-4594-b490-7655cfd6e856 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:53.872991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:53.874067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:47:53.875044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 576/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:47:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:53.880785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181c2c-7e65-4ae3-99a1-1726eab31f48 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:53.988668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181c2c-7e65-4ae3-99a1-1726eab31f48 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:54.022427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:54.023105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:54.023394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:54.023677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:54.024433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:54.024745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:54.026160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:54.035018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 574/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:54.041037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b56d1-2223-4594-b490-7655cfd6e856 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:54.058382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:54.151045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b56d1-2223-4594-b490-7655cfd6e856 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:54.186039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60671c-fc28-4953-bcab-e9d77dd1aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:54.187109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60671c-fc28-4953-bcab-e9d77dd1aea9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:54.187584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60671c-fc28-4953-bcab-e9d77dd1aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:54.188073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60671c-fc28-4953-bcab-e9d77dd1aea9 None admin] PATH_INFO: `/v3/users/523b95797d194f56ac8828d8bacd63c0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:54.189522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60671c-fc28-4953-bcab-e9d77dd1aea9 None admin] RBAC: Authorizing `identity:get_user(user_id=523b95797d194f56ac8828d8bacd63c0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:54.191049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60671c-fc28-4953-bcab-e9d77dd1aea9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:54.192721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 577/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:54 2022] GET /identity/v3/users/523b95797d194f56ac8828d8bacd63c0 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:54.198588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:54.229231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:54.302986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336253e-f67f-4c80-b5dc-55234e851f6d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:54.336793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fcb02-f91b-4c50-9927-2d55ed6a614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:54.337688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fcb02-f91b-4c50-9927-2d55ed6a614d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:54.337974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fcb02-f91b-4c50-9927-2d55ed6a614d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:54.338250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fcb02-f91b-4c50-9927-2d55ed6a614d None admin] PATH_INFO: `/v3/projects/40310c857efe4f678f579abd6e131d66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:54.339427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fcb02-f91b-4c50-9927-2d55ed6a614d None admin] RBAC: Authorizing `identity:get_project(project_id=40310c857efe4f678f579abd6e131d66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:54.340865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fcb02-f91b-4c50-9927-2d55ed6a614d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:54.342622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 575/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:54 2022] GET /identity/v3/projects/40310c857efe4f678f579abd6e131d66 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:54.349404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60671c-fc28-4953-bcab-e9d77dd1aea9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:54.433052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:54.451212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60671c-fc28-4953-bcab-e9d77dd1aea9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:54.489183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43932365-4d54-4061-8705-77e40948dad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:54.490123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932365-4d54-4061-8705-77e40948dad2 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:54.490417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932365-4d54-4061-8705-77e40948dad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:54.490960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43932365-4d54-4061-8705-77e40948dad2 None admin] PATH_INFO: `/v3/projects/40310c857efe4f678f579abd6e131d66/users/523b95797d194f56ac8828d8bacd63c0/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:54.492998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43932365-4d54-4061-8705-77e40948dad2 None admin] RBAC: Authorizing `identity:create_grant(project_id=40310c857efe4f678f579abd6e131d66, user_id=523b95797d194f56ac8828d8bacd63c0, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:54.494499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43932365-4d54-4061-8705-77e40948dad2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:54.509240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 578/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:47:54 2022] PUT /identity/v3/projects/40310c857efe4f678f579abd6e131d66/users/523b95797d194f56ac8828d8bacd63c0/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:47:56.798254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276c2d-c4ab-49d5-a38e-3610ef84e5ed None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:56.798918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276c2d-c4ab-49d5-a38e-3610ef84e5ed None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:56.798918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276c2d-c4ab-49d5-a38e-3610ef84e5ed None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:56.800088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 576/1154] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:47:56.805909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c8bd-00b1-441c-823f-3ab48b8a8070 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:56.806375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c8bd-00b1-441c-823f-3ab48b8a8070 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:56.806468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c8bd-00b1-441c-823f-3ab48b8a8070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:56.825037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ce77c8bd-00b1-441c-823f-3ab48b8a8070 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:47:56.826279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ce77c8bd-00b1-441c-823f-3ab48b8a8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:47:56.894624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 579/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:47:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:47:56.918488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f276c2d-c4ab-49d5-a38e-3610ef84e5ed None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:57.017306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:57.025096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f276c2d-c4ab-49d5-a38e-3610ef84e5ed None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:57.061960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418366e-d613-4601-ada3-ade9d302ce2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:57.063160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418366e-d613-4601-ada3-ade9d302ce2c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:57.063454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418366e-d613-4601-ada3-ade9d302ce2c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:57.063740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418366e-d613-4601-ada3-ade9d302ce2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:57.075045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418366e-d613-4601-ada3-ade9d302ce2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1418366e-d613-4601-ada3-ade9d302ce2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:47:57.083279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:47:57.084509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:47:57.085763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 577/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:47:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:47:57.090708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c8bd-00b1-441c-823f-3ab48b8a8070 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:57.163440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:57.195144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c8bd-00b1-441c-823f-3ab48b8a8070 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:57.229536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:57.230242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:57.230534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:57.230820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:57.231582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:57.231897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:57.234118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:57.245653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 580/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:47:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:57.252695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418366e-d613-4601-ada3-ade9d302ce2c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:57.353804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418366e-d613-4601-ada3-ade9d302ce2c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:57.389170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fdf5b-a29d-486a-a1bb-10fe1eb565ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:57.390153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fdf5b-a29d-486a-a1bb-10fe1eb565ad None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:57.390437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fdf5b-a29d-486a-a1bb-10fe1eb565ad None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:57.390720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fdf5b-a29d-486a-a1bb-10fe1eb565ad None admin] PATH_INFO: `/v3/users/523b95797d194f56ac8828d8bacd63c0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:57.391964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fdf5b-a29d-486a-a1bb-10fe1eb565ad None admin] RBAC: Authorizing `identity:get_user(user_id=523b95797d194f56ac8828d8bacd63c0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:57.393437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fdf5b-a29d-486a-a1bb-10fe1eb565ad None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:57.395136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 578/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:47:57 2022] GET /identity/v3/users/523b95797d194f56ac8828d8bacd63c0 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:57.400946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:57.504126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa296c3-4cd5-48ca-a515-c0ff916d26f1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:57.537127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccde6b-56e3-4a08-acd7-ebf6d5fd6fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:57.537815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccde6b-56e3-4a08-acd7-ebf6d5fd6fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:57.538103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccde6b-56e3-4a08-acd7-ebf6d5fd6fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:57.538384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccde6b-56e3-4a08-acd7-ebf6d5fd6fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:57.541015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:57.609270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccde6b-56e3-4a08-acd7-ebf6d5fd6fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:57.611052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccde6b-56e3-4a08-acd7-ebf6d5fd6fe9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:57.711611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 581/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:47:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:47:57.717452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fdf5b-a29d-486a-a1bb-10fe1eb565ad None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:57.744542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:57.822128 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fdf5b-a29d-486a-a1bb-10fe1eb565ad None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:57.863634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bc083-bcac-4c03-8fe4-c0d2c5f6ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:57.864409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc083-bcac-4c03-8fe4-c0d2c5f6ca33 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:57.864697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc083-bcac-4c03-8fe4-c0d2c5f6ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:57.864976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc083-bcac-4c03-8fe4-c0d2c5f6ca33 None admin] PATH_INFO: `/v3/projects/40310c857efe4f678f579abd6e131d66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:57.866462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bc083-bcac-4c03-8fe4-c0d2c5f6ca33 None admin] RBAC: Authorizing `identity:get_project(project_id=40310c857efe4f678f579abd6e131d66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:57.867906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bc083-bcac-4c03-8fe4-c0d2c5f6ca33 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:57.869647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 579/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:47:57 2022] GET /identity/v3/projects/40310c857efe4f678f579abd6e131d66 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:47:57.875871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccde6b-56e3-4a08-acd7-ebf6d5fd6fe9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:47:57.916543 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:47:57.983813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccde6b-56e3-4a08-acd7-ebf6d5fd6fe9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:47:58.018734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8494a-0903-482d-af02-68f7665bd142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:47:58.019400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8494a-0903-482d-af02-68f7665bd142 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:47:58.019691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8494a-0903-482d-af02-68f7665bd142 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:47:58.019974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8494a-0903-482d-af02-68f7665bd142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:47:58.020823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8494a-0903-482d-af02-68f7665bd142 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=40310c857efe4f678f579abd6e131d66, user.id=523b95797d194f56ac8828d8bacd63c0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:47:58.021141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8494a-0903-482d-af02-68f7665bd142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:47:58.022633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8494a-0903-482d-af02-68f7665bd142 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:47:58.028680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 582/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:47:57 2022] GET /identity/v3/role_assignments?user.id=523b95797d194f56ac8828d8bacd63c0&scope.project.id=40310c857efe4f678f579abd6e131d66&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:00.343328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c63f-e59d-4026-befc-f631744ea779 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:00.343865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c63f-e59d-4026-befc-f631744ea779 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:00.343986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c63f-e59d-4026-befc-f631744ea779 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:00.345367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 580/1162] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:48:00.350803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68919e-6282-451c-b807-cb626a07112c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:00.351202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68919e-6282-451c-b807-cb626a07112c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:00.351372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68919e-6282-451c-b807-cb626a07112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:00.368406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1d68919e-6282-451c-b807-cb626a07112c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:48:00.369742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1d68919e-6282-451c-b807-cb626a07112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:48:00.437938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 583/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:48:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:48:00.460988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63c63f-e59d-4026-befc-f631744ea779 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:00.554249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:00.565211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63c63f-e59d-4026-befc-f631744ea779 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:00.602741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123871-ec7a-4168-9c8f-4987c2e46040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:00.603314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123871-ec7a-4168-9c8f-4987c2e46040 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:00.603610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123871-ec7a-4168-9c8f-4987c2e46040 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:00.603890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123871-ec7a-4168-9c8f-4987c2e46040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:00.673564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb123871-ec7a-4168-9c8f-4987c2e46040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:00.675038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb123871-ec7a-4168-9c8f-4987c2e46040 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:00.767712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:00.777784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 581/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:48:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:48:00.784282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68919e-6282-451c-b807-cb626a07112c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:00.813077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:00.895786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68919e-6282-451c-b807-cb626a07112c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:00.930837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062ae8e-98d7-46d6-a34e-2a4b56cb97b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:00.931648 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062ae8e-98d7-46d6-a34e-2a4b56cb97b3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:00.931938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062ae8e-98d7-46d6-a34e-2a4b56cb97b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:00.932219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062ae8e-98d7-46d6-a34e-2a4b56cb97b3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:00.940089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062ae8e-98d7-46d6-a34e-2a4b56cb97b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:00.941609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062ae8e-98d7-46d6-a34e-2a4b56cb97b3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2062ae8e-98d7-46d6-a34e-2a4b56cb97b3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:48:00.956805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:48:00.958147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:48:00.959134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 584/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:48:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:48:00.964964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123871-ec7a-4168-9c8f-4987c2e46040 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:01.074484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123871-ec7a-4168-9c8f-4987c2e46040 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:01.110254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613c00-7412-4994-ab41-26db6138edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:01.110932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613c00-7412-4994-ab41-26db6138edf8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:01.111222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613c00-7412-4994-ab41-26db6138edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:01.111504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613c00-7412-4994-ab41-26db6138edf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:01.112269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613c00-7412-4994-ab41-26db6138edf8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:48:01.112585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613c00-7412-4994-ab41-26db6138edf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:01.113996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613c00-7412-4994-ab41-26db6138edf8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:01.121955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 582/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 8 12:48:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:48:03.445875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c91e7-c388-40ac-b336-b3d42338b376 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:03.446456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c91e7-c388-40ac-b336-b3d42338b376 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:03.446456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c91e7-c388-40ac-b336-b3d42338b376 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:03.447797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 585/1167] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:48:03.453959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b907-f2b3-480e-b20c-253aa4ed740d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:03.454473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b907-f2b3-480e-b20c-253aa4ed740d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:03.454589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b907-f2b3-480e-b20c-253aa4ed740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:03.471850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-42b1b907-f2b3-480e-b20c-253aa4ed740d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:48:03.473041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-42b1b907-f2b3-480e-b20c-253aa4ed740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:48:03.530709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:03.548014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 583/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:48:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:48:03.571367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c91e7-c388-40ac-b336-b3d42338b376 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:03.673263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:03.686161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c91e7-c388-40ac-b336-b3d42338b376 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:03.721098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb3510-ce72-4db2-9839-c4227b9aebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:03.721795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb3510-ce72-4db2-9839-c4227b9aebab None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:03.722082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb3510-ce72-4db2-9839-c4227b9aebab None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:03.722360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb3510-ce72-4db2-9839-c4227b9aebab None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:03.723116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb3510-ce72-4db2-9839-c4227b9aebab None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:03.724491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb3510-ce72-4db2-9839-c4227b9aebab None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:03.741151 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 586/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Wed Jun 8 12:48:03 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:48:06.049202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50906d-99d6-4903-b4fb-3c55450ca3b6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:06.049796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50906d-99d6-4903-b4fb-3c55450ca3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:06.049931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50906d-99d6-4903-b4fb-3c55450ca3b6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:06.051326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 584/1170] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:48:06.056916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71661da9-323b-4110-b176-a20ad83703f2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:06.057367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71661da9-323b-4110-b176-a20ad83703f2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:06.057468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71661da9-323b-4110-b176-a20ad83703f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:06.075299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-71661da9-323b-4110-b176-a20ad83703f2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:48:06.076499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-71661da9-323b-4110-b176-a20ad83703f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:48:06.148754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 587/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:48:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:48:06.176163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50906d-99d6-4903-b4fb-3c55450ca3b6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:06.287048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50906d-99d6-4903-b4fb-3c55450ca3b6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:06.320398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fa90f-d088-439c-a380-8786defd8840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:06.321266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fa90f-d088-439c-a380-8786defd8840 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:06.321588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fa90f-d088-439c-a380-8786defd8840 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:06.321983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fa90f-d088-439c-a380-8786defd8840 None admin] PATH_INFO: `/v3/domains/2b9dde3f05174536a673c55d790397ab` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:06.333439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fa90f-d088-439c-a380-8786defd8840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2b9dde3f05174536a673c55d790397ab)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:06.334918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fa90f-d088-439c-a380-8786defd8840 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:06.336628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 585/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Jun 8 12:48:06 2022] GET /identity/v3/domains/2b9dde3f05174536a673c55d790397ab => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:48:06.343115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71661da9-323b-4110-b176-a20ad83703f2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:06.426875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:06.449228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71661da9-323b-4110-b176-a20ad83703f2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:06.484549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18a378-a70d-4be9-a96f-80d9e11c4355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:06.485226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a378-a70d-4be9-a96f-80d9e11c4355 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:06.485514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a378-a70d-4be9-a96f-80d9e11c4355 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:06.485824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a378-a70d-4be9-a96f-80d9e11c4355 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:06.486552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a378-a70d-4be9-a96f-80d9e11c4355 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:06.488006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a378-a70d-4be9-a96f-80d9e11c4355 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:06.515636 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 588/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:48:06 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:48:08.834599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35068-3de3-40b3-83f1-3955a2d822d1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:08.835153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35068-3de3-40b3-83f1-3955a2d822d1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:08.835153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35068-3de3-40b3-83f1-3955a2d822d1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:08.836551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 586/1174] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:48:08.842007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b0da-da41-45ac-a3ab-6449c0db3eeb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:08.843001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b0da-da41-45ac-a3ab-6449c0db3eeb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:08.843101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b0da-da41-45ac-a3ab-6449c0db3eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:08.860202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3fe2b0da-da41-45ac-a3ab-6449c0db3eeb None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:48:08.861384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3fe2b0da-da41-45ac-a3ab-6449c0db3eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:48:08.928563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 589/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:48:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:48:08.953513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee35068-3de3-40b3-83f1-3955a2d822d1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:09.002724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:09.060985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee35068-3de3-40b3-83f1-3955a2d822d1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:09.097392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea7be1-72e9-48da-8036-3b3509312595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:09.098213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7be1-72e9-48da-8036-3b3509312595 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:09.098501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7be1-72e9-48da-8036-3b3509312595 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:09.098785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7be1-72e9-48da-8036-3b3509312595 None admin] PATH_INFO: `/v3/domains/2b9dde3f05174536a673c55d790397ab` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:09.099989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea7be1-72e9-48da-8036-3b3509312595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2b9dde3f05174536a673c55d790397ab)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:09.101445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea7be1-72e9-48da-8036-3b3509312595 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:09.103118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 587/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Jun 8 12:48:08 2022] GET /identity/v3/domains/2b9dde3f05174536a673c55d790397ab => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:09.109779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2b0da-da41-45ac-a3ab-6449c0db3eeb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:09.169128 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:09.210907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2b0da-da41-45ac-a3ab-6449c0db3eeb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:09.246330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd9b98-67aa-4670-8fbb-5fd7b2ddc9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:09.247003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9b98-67aa-4670-8fbb-5fd7b2ddc9b3 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:09.247286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9b98-67aa-4670-8fbb-5fd7b2ddc9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:09.247565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9b98-67aa-4670-8fbb-5fd7b2ddc9b3 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:09.248332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd9b98-67aa-4670-8fbb-5fd7b2ddc9b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:09.249818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd9b98-67aa-4670-8fbb-5fd7b2ddc9b3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:09.271246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 590/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:48:09 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:48:11.633066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef833-6864-48ed-991e-e4d0febd4c65 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:11.633657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef833-6864-48ed-991e-e4d0febd4c65 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:11.633657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef833-6864-48ed-991e-e4d0febd4c65 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:11.635044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 588/1178] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:48:11.640697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1e796-6ad5-4fa8-836f-fbefe5c7deff None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:11.641160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1e796-6ad5-4fa8-836f-fbefe5c7deff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:11.641275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1e796-6ad5-4fa8-836f-fbefe5c7deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:11.658217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f5b1e796-6ad5-4fa8-836f-fbefe5c7deff None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:48:11.659400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f5b1e796-6ad5-4fa8-836f-fbefe5c7deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:48:11.730685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 591/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:48:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:48:11.761833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcef833-6864-48ed-991e-e4d0febd4c65 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:11.866757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcef833-6864-48ed-991e-e4d0febd4c65 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:11.881219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:11.901627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522306f-0637-4c88-8e5f-97b1a5e832fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:11.902427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522306f-0637-4c88-8e5f-97b1a5e832fc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:11.902713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522306f-0637-4c88-8e5f-97b1a5e832fc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:11.902993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522306f-0637-4c88-8e5f-97b1a5e832fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:11.914524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522306f-0637-4c88-8e5f-97b1a5e832fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d522306f-0637-4c88-8e5f-97b1a5e832fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:48:11.923056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:48:11.924248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:48:11.925442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 589/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:48:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:48:11.930441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1e796-6ad5-4fa8-836f-fbefe5c7deff None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:11.975837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:12.029148 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1e796-6ad5-4fa8-836f-fbefe5c7deff None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:12.065637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:12.066458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:12.066804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:12.067122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:12.068067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:48:12.068377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:12.069789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:12.078564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 592/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:12.084486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522306f-0637-4c88-8e5f-97b1a5e832fc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:12.185080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522306f-0637-4c88-8e5f-97b1a5e832fc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:12.221470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a847c8-235f-4d66-8de7-ce02802414e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:12.222380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a847c8-235f-4d66-8de7-ce02802414e2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:12.222667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a847c8-235f-4d66-8de7-ce02802414e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:12.222952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a847c8-235f-4d66-8de7-ce02802414e2 None admin] PATH_INFO: `/v3/users/dec6afcfcc08428bab64518793adb952` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:12.238835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a847c8-235f-4d66-8de7-ce02802414e2 None admin] RBAC: Authorizing `identity:get_user(user_id=dec6afcfcc08428bab64518793adb952)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:12.240306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a847c8-235f-4d66-8de7-ce02802414e2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:12.242338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 590/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:48:12 2022] GET /identity/v3/users/dec6afcfcc08428bab64518793adb952 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:12.248180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:12.350503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fe5af-7a87-4fbe-b6c8-bd9985b4a412 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:12.360231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:12.386054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ecabb-4899-455b-adcc-c8b13c017f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:12.386717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ecabb-4899-455b-adcc-c8b13c017f13 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:12.387009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ecabb-4899-455b-adcc-c8b13c017f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:12.387294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ecabb-4899-455b-adcc-c8b13c017f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:12.459047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ecabb-4899-455b-adcc-c8b13c017f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:12.460518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ecabb-4899-455b-adcc-c8b13c017f13 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:12.558861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 593/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:48:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:48:12.565700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a847c8-235f-4d66-8de7-ce02802414e2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:12.596755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:12.672537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a847c8-235f-4d66-8de7-ce02802414e2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:12.707201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84604807-d87e-4985-ba11-e7686419d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:12.708073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84604807-d87e-4985-ba11-e7686419d661 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:12.708362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84604807-d87e-4985-ba11-e7686419d661 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:12.708646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84604807-d87e-4985-ba11-e7686419d661 None admin] PATH_INFO: `/v3/projects/b1f27573374c4b75b6339c2a4bdb49d1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:12.709862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84604807-d87e-4985-ba11-e7686419d661 None admin] RBAC: Authorizing `identity:get_project(project_id=b1f27573374c4b75b6339c2a4bdb49d1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:12.711296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84604807-d87e-4985-ba11-e7686419d661 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:12.713008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 591/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:48:12 2022] GET /identity/v3/projects/b1f27573374c4b75b6339c2a4bdb49d1 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:12.719892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ecabb-4899-455b-adcc-c8b13c017f13 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:12.738020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:12.854392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ecabb-4899-455b-adcc-c8b13c017f13 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:12.890511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ab0b-c603-4648-ae51-7b7e69611470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:12.891269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ab0b-c603-4648-ae51-7b7e69611470 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:12.891565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ab0b-c603-4648-ae51-7b7e69611470 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:12.891835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ab0b-c603-4648-ae51-7b7e69611470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:12.892676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ab0b-c603-4648-ae51-7b7e69611470 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=b1f27573374c4b75b6339c2a4bdb49d1, user.id=dec6afcfcc08428bab64518793adb952) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:48:12.892995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ab0b-c603-4648-ae51-7b7e69611470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:12.894481 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ab0b-c603-4648-ae51-7b7e69611470 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:12.900173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 594/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:48:12 2022] GET /identity/v3/role_assignments?user.id=dec6afcfcc08428bab64518793adb952&scope.project.id=b1f27573374c4b75b6339c2a4bdb49d1&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:15.286304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab99d8-cefd-4307-bc08-959e95e00fff None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:15.286862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab99d8-cefd-4307-bc08-959e95e00fff None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:15.286862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab99d8-cefd-4307-bc08-959e95e00fff None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:15.288255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 592/1186] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:48:15.293760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414309e2-0d3e-4c41-b032-3aff112aa536 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:15.294197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414309e2-0d3e-4c41-b032-3aff112aa536 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:15.294325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414309e2-0d3e-4c41-b032-3aff112aa536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:15.312257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-414309e2-0d3e-4c41-b032-3aff112aa536 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:48:15.313447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-414309e2-0d3e-4c41-b032-3aff112aa536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:48:15.382955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 595/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:48:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:48:15.406683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab99d8-cefd-4307-bc08-959e95e00fff None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:15.527445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:15.531830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab99d8-cefd-4307-bc08-959e95e00fff None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:15.566604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0c142-6aa7-48b7-8689-80f470a42e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:15.567315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c142-6aa7-48b7-8689-80f470a42e57 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:15.567604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c142-6aa7-48b7-8689-80f470a42e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:15.567883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c142-6aa7-48b7-8689-80f470a42e57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:15.579103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0c142-6aa7-48b7-8689-80f470a42e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9dc0c142-6aa7-48b7-8689-80f470a42e57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:48:15.586781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:48:15.587937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:48:15.588905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 593/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:48:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:48:15.594108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414309e2-0d3e-4c41-b032-3aff112aa536 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:15.596300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:15.696080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414309e2-0d3e-4c41-b032-3aff112aa536 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:15.731087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:15.731763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:15.732052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:15.732331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:15.733659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:48:15.733974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:15.735364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:15.744153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 596/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:15.751327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0c142-6aa7-48b7-8689-80f470a42e57 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:15.858430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0c142-6aa7-48b7-8689-80f470a42e57 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:15.892283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf73d3-c9dc-4656-af89-369090ec6afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:15.893153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf73d3-c9dc-4656-af89-369090ec6afa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:15.893438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf73d3-c9dc-4656-af89-369090ec6afa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:15.893747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf73d3-c9dc-4656-af89-369090ec6afa None admin] PATH_INFO: `/v3/users/dec6afcfcc08428bab64518793adb952` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:15.894925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf73d3-c9dc-4656-af89-369090ec6afa None admin] RBAC: Authorizing `identity:get_user(user_id=dec6afcfcc08428bab64518793adb952)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:15.896356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf73d3-c9dc-4656-af89-369090ec6afa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:15.898073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 594/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:48:15 2022] GET /identity/v3/users/dec6afcfcc08428bab64518793adb952 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:15.903902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:15.968387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:16.006750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52d15c-ca29-4307-a14e-5de03c95066d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:16.041816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ff1ca-e54c-4d78-8685-9cc2f66e3a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:16.042691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ff1ca-e54c-4d78-8685-9cc2f66e3a08 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:16.042982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ff1ca-e54c-4d78-8685-9cc2f66e3a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:16.043266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ff1ca-e54c-4d78-8685-9cc2f66e3a08 None admin] PATH_INFO: `/v3/projects/b1f27573374c4b75b6339c2a4bdb49d1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:16.044458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ff1ca-e54c-4d78-8685-9cc2f66e3a08 None admin] RBAC: Authorizing `identity:get_project(project_id=b1f27573374c4b75b6339c2a4bdb49d1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:16.046651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ff1ca-e54c-4d78-8685-9cc2f66e3a08 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:16.048401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 597/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:48:15 2022] GET /identity/v3/projects/b1f27573374c4b75b6339c2a4bdb49d1 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:16.054391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf73d3-c9dc-4656-af89-369090ec6afa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:16.082987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:16.155510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf73d3-c9dc-4656-af89-369090ec6afa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:16.189216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401ddb8-b1de-4b68-8e98-9761829563f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:16.190147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401ddb8-b1de-4b68-8e98-9761829563f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:16.190434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401ddb8-b1de-4b68-8e98-9761829563f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:16.190713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401ddb8-b1de-4b68-8e98-9761829563f7 None admin] PATH_INFO: `/v3/projects/b1f27573374c4b75b6339c2a4bdb49d1/users/dec6afcfcc08428bab64518793adb952/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:16.192683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401ddb8-b1de-4b68-8e98-9761829563f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1f27573374c4b75b6339c2a4bdb49d1, user_id=dec6afcfcc08428bab64518793adb952, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:16.194164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401ddb8-b1de-4b68-8e98-9761829563f7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:16.209729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 595/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:48:16 2022] PUT /identity/v3/projects/b1f27573374c4b75b6339c2a4bdb49d1/users/dec6afcfcc08428bab64518793adb952/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:48:18.521673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753990e1-9f52-48f8-8196-e3ef3ba1a0e1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:18.522223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753990e1-9f52-48f8-8196-e3ef3ba1a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:18.522223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753990e1-9f52-48f8-8196-e3ef3ba1a0e1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:18.523597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 598/1193] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:48:18.528891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270517-1d09-4383-9868-94cd546c8f02 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:18.529294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270517-1d09-4383-9868-94cd546c8f02 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:18.529463 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270517-1d09-4383-9868-94cd546c8f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:18.546128 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-93270517-1d09-4383-9868-94cd546c8f02 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:48:18.547340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-93270517-1d09-4383-9868-94cd546c8f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:48:18.616336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 596/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:48:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:48:18.641468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753990e1-9f52-48f8-8196-e3ef3ba1a0e1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:18.752655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753990e1-9f52-48f8-8196-e3ef3ba1a0e1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:18.781723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:18.787041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2775d-8845-49b3-987f-5b106bf0d261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:18.787841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2775d-8845-49b3-987f-5b106bf0d261 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:18.788127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2775d-8845-49b3-987f-5b106bf0d261 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:18.788407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2775d-8845-49b3-987f-5b106bf0d261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:18.800265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2775d-8845-49b3-987f-5b106bf0d261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c2c2775d-8845-49b3-987f-5b106bf0d261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:48:18.807881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:48:18.809020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:48:18.810093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 599/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:48:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:48:18.816190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270517-1d09-4383-9868-94cd546c8f02 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:18.834726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:18.917766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270517-1d09-4383-9868-94cd546c8f02 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:18.958022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:18.958697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:18.958981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:18.959261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:18.960009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:48:18.960316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:18.961713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:18.971955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 597/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:18.977790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2775d-8845-49b3-987f-5b106bf0d261 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:19.080058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2775d-8845-49b3-987f-5b106bf0d261 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:19.117727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255d27e-a483-45d5-a4d4-decb82698ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:19.118603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d27e-a483-45d5-a4d4-decb82698ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:19.118890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d27e-a483-45d5-a4d4-decb82698ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:19.119169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d27e-a483-45d5-a4d4-decb82698ac3 None admin] PATH_INFO: `/v3/users/dec6afcfcc08428bab64518793adb952` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:19.120367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255d27e-a483-45d5-a4d4-decb82698ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=dec6afcfcc08428bab64518793adb952)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:19.121838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255d27e-a483-45d5-a4d4-decb82698ac3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:19.123828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 600/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 8 12:48:18 2022] GET /identity/v3/users/dec6afcfcc08428bab64518793adb952 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:19.129829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:19.211490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:19.231581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b16ec-330c-4e9f-979c-c407b351daf5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:19.266154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f59a12-4ba7-4f1d-8b9e-1a3c44e2428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:19.266814 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f59a12-4ba7-4f1d-8b9e-1a3c44e2428e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:19.267101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f59a12-4ba7-4f1d-8b9e-1a3c44e2428e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:19.267387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f59a12-4ba7-4f1d-8b9e-1a3c44e2428e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:19.336215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f59a12-4ba7-4f1d-8b9e-1a3c44e2428e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:19.337613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f59a12-4ba7-4f1d-8b9e-1a3c44e2428e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:19.419254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:19.442536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 598/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:48:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:48:19.448651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255d27e-a483-45d5-a4d4-decb82698ac3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:19.512087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:19.556656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255d27e-a483-45d5-a4d4-decb82698ac3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:19.592908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509ed8-6640-44a6-afcd-bfc275496795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:19.593712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509ed8-6640-44a6-afcd-bfc275496795 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:19.594000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509ed8-6640-44a6-afcd-bfc275496795 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:19.594279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509ed8-6640-44a6-afcd-bfc275496795 None admin] PATH_INFO: `/v3/projects/b1f27573374c4b75b6339c2a4bdb49d1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:19.595475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27509ed8-6640-44a6-afcd-bfc275496795 None admin] RBAC: Authorizing `identity:get_project(project_id=b1f27573374c4b75b6339c2a4bdb49d1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:19.596925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27509ed8-6640-44a6-afcd-bfc275496795 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:19.598680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 601/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 8 12:48:19 2022] GET /identity/v3/projects/b1f27573374c4b75b6339c2a4bdb49d1 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:19.604827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f59a12-4ba7-4f1d-8b9e-1a3c44e2428e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:48:19.704631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f59a12-4ba7-4f1d-8b9e-1a3c44e2428e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:48:19.741791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8526911-5037-46c7-b86b-e914ec34cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:48:19.742453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526911-5037-46c7-b86b-e914ec34cda1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:48:19.742738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526911-5037-46c7-b86b-e914ec34cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:48:19.743016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526911-5037-46c7-b86b-e914ec34cda1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:48:19.743850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8526911-5037-46c7-b86b-e914ec34cda1 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=b1f27573374c4b75b6339c2a4bdb49d1, user.id=dec6afcfcc08428bab64518793adb952) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:48:19.744163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8526911-5037-46c7-b86b-e914ec34cda1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:48:19.745615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8526911-5037-46c7-b86b-e914ec34cda1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:48:19.753014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 599/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:48:19 2022] GET /identity/v3/role_assignments?user.id=dec6afcfcc08428bab64518793adb952&scope.project.id=b1f27573374c4b75b6339c2a4bdb49d1&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:48:29.587859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=36 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:48:29.750420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=78 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:22.684642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aaa16-ef78-478d-8678-da95db2f1115 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:22.685188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aaa16-ef78-478d-8678-da95db2f1115 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:22.685188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aaa16-ef78-478d-8678-da95db2f1115 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:22.686829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 602/1201] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:49:22.693388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa05e-461c-489b-8490-1d20a79aaf85 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:22.693948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa05e-461c-489b-8490-1d20a79aaf85 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:22.694070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfa05e-461c-489b-8490-1d20a79aaf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:22.715653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3bcfa05e-461c-489b-8490-1d20a79aaf85 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:22.717185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3bcfa05e-461c-489b-8490-1d20a79aaf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:22.825593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 600/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:49:22.849696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aaa16-ef78-478d-8678-da95db2f1115 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:22.996392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aaa16-ef78-478d-8678-da95db2f1115 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:23.041220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:23.042186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:23.043122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:23.043456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:23.055383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:23.057251 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:23.078578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:23.079708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:23.080690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:23.080690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:23.080690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:23.080690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:23.089422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 603/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:23.089679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfa05e-461c-489b-8490-1d20a79aaf85 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:23.238073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfa05e-461c-489b-8490-1d20a79aaf85 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:23.284805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:23.292753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30bfe9-c4c0-45b7-8606-8c3ce1570091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:23.293594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30bfe9-c4c0-45b7-8606-8c3ce1570091 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:23.294081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30bfe9-c4c0-45b7-8606-8c3ce1570091 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:23.294558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30bfe9-c4c0-45b7-8606-8c3ce1570091 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:23.295447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30bfe9-c4c0-45b7-8606-8c3ce1570091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:23.295950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30bfe9-c4c0-45b7-8606-8c3ce1570091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:23.297478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30bfe9-c4c0-45b7-8606-8c3ce1570091 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:23.312461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 601/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:23.318354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:23.425602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:23.511765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e17ac-618e-47e8-8d22-5432c007117d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:23.556410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a795c-3606-4c33-a3b9-79958b2031ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:23.557023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a795c-3606-4c33-a3b9-79958b2031ae None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:23.557316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a795c-3606-4c33-a3b9-79958b2031ae None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:23.558163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a795c-3606-4c33-a3b9-79958b2031ae None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:23.559068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a795c-3606-4c33-a3b9-79958b2031ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:23.560541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a795c-3606-4c33-a3b9-79958b2031ae None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:23.589571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 604/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 8 12:49:23 2022] POST /identity/v3/users => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:49:26.274941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2859e33-c191-4133-8ead-18fa418d04f1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:26.275528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2859e33-c191-4133-8ead-18fa418d04f1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:26.275528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2859e33-c191-4133-8ead-18fa418d04f1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:26.277664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 602/1206] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:49:26.283463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215b15-c0dc-454c-b3d8-bdbc6362e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:26.283980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215b15-c0dc-454c-b3d8-bdbc6362e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:26.284071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215b15-c0dc-454c-b3d8-bdbc6362e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:26.303311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-16215b15-c0dc-454c-b3d8-bdbc6362e8f3 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:26.304627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-16215b15-c0dc-454c-b3d8-bdbc6362e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:26.397205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 605/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:49:26.422203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2859e33-c191-4133-8ead-18fa418d04f1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:26.553319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2859e33-c191-4133-8ead-18fa418d04f1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:26.608200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10318c7-922c-491c-b946-3089ecd045a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:26.609482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10318c7-922c-491c-b946-3089ecd045a7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:26.610025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10318c7-922c-491c-b946-3089ecd045a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:26.610326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10318c7-922c-491c-b946-3089ecd045a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:26.627691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10318c7-922c-491c-b946-3089ecd045a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b10318c7-922c-491c-b946-3089ecd045a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:49:26.636839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:26.640300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:26.641971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 603/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:49:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:26.645236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16215b15-c0dc-454c-b3d8-bdbc6362e8f3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:26.692632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:26.765475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16215b15-c0dc-454c-b3d8-bdbc6362e8f3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:26.806210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:26.807203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:26.808146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:26.808805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:26.810218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:26.810549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:26.812145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:26.822812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 606/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:49:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:26.829560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10318c7-922c-491c-b946-3089ecd045a7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:26.905709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:26.980396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10318c7-922c-491c-b946-3089ecd045a7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:27.029289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:27.030268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:27.030564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:27.030848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:27.044300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:27.045890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:27.073563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:27.074608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:27.075550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:27.075550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:27.075550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:27.075550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:27.076820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 604/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:27.083456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:27.242704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:27.249199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4d456-1cb2-46fa-a842-4746e7066a1d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:27.293119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:27.293926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:27.294133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:27.294439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:27.295283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:27.295750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:27.297388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:27.317684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 607/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:27.320012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:27.453771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc9fd-ff92-4a04-905c-bda12137d3fa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:27.456246 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:27.527404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:27.528478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:27.528749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:27.529035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:27.541453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:27.543935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:49:27.562768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:27.564129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:27.565391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 605/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:27.570839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:27.720585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5980-eea3-48ef-b98c-5eb3c5b35c78 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:27.774913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:27.775893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:27.777032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:27.777480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:27.778510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:27.778875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:27.780404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:27.801017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 608/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 8 12:49:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:27.808380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:27.942646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412ee63-128e-4044-a18d-c90e959be841 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:27.994405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c47dbe-897a-4c39-b9fb-4a47737fd492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:27.995523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c47dbe-897a-4c39-b9fb-4a47737fd492 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:27.995987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c47dbe-897a-4c39-b9fb-4a47737fd492 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:27.996270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c47dbe-897a-4c39-b9fb-4a47737fd492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:28.028825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:28.102369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c47dbe-897a-4c39-b9fb-4a47737fd492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:28.104862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c47dbe-897a-4c39-b9fb-4a47737fd492 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:28.254784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 606/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:49:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:49:28.256342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:28.287044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:28.406970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def462f-861b-46cf-83fc-377cf66e6203 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:28.457218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:28.458137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:28.458422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:28.459126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:28.472596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:28.474242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:28.495878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:28.497205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:28.498563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:28.498563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:28.498563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:28.498563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:28.509075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 609/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:28.513586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c47dbe-897a-4c39-b9fb-4a47737fd492 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:28.590864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:28.658150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c47dbe-897a-4c39-b9fb-4a47737fd492 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:28.712001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:28.712910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:28.713209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:28.713674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:28.714587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:28.714984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:28.718207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:28.732103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 607/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:28.740269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:28.823266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:28.867487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab2e9b-3832-43f0-84c3-be31114db4f8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:28.930661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:28.931474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:28.931757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:28.932030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:28.940342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:28.941841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:49:28.957676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:28.958833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:28.960554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 610/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:28.969412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:29.129474 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd07962-2692-465d-927e-a0d66d385a93 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:29.159004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:29.176760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69751c6a-7059-49ac-a0ae-53abb27e9bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:29.177431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751c6a-7059-49ac-a0ae-53abb27e9bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:29.177744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751c6a-7059-49ac-a0ae-53abb27e9bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:29.178020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751c6a-7059-49ac-a0ae-53abb27e9bd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:29.178812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69751c6a-7059-49ac-a0ae-53abb27e9bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:29.179141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69751c6a-7059-49ac-a0ae-53abb27e9bd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:29.180559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69751c6a-7059-49ac-a0ae-53abb27e9bd1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:29.194574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 608/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:29.202289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:29.337821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afc76-374f-47d3-af9c-f38ec7c00cdd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:29.376422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:29.387529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6ced5-2b61-49cb-9c81-9764d803869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:29.388637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ced5-2b61-49cb-9c81-9764d803869f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:29.389274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ced5-2b61-49cb-9c81-9764d803869f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:29.389779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ced5-2b61-49cb-9c81-9764d803869f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:29.391235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6ced5-2b61-49cb-9c81-9764d803869f None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=a6bc294afca749e5bc2d44c65ea7f96b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:29.391669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6ced5-2b61-49cb-9c81-9764d803869f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:29.393687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6ced5-2b61-49cb-9c81-9764d803869f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:29.400760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 611/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:49:29 2022] GET /identity/v3/role_assignments?user.id=a6bc294afca749e5bc2d44c65ea7f96b&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:49:31.808794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7978-cdd6-4b47-ab9b-543cd5f9bf63 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:31.809323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7978-cdd6-4b47-ab9b-543cd5f9bf63 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:31.809411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7978-cdd6-4b47-ab9b-543cd5f9bf63 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:31.810965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 609/1220] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:49:31.816717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad407-bbf3-4a80-8066-cf411e9f0b17 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:31.817198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad407-bbf3-4a80-8066-cf411e9f0b17 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:31.817298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad407-bbf3-4a80-8066-cf411e9f0b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:31.840166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bf4ad407-bbf3-4a80-8066-cf411e9f0b17 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:31.842110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf4ad407-bbf3-4a80-8066-cf411e9f0b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:31.940952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 612/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:49:31.967592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7978-cdd6-4b47-ab9b-543cd5f9bf63 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:32.096026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7978-cdd6-4b47-ab9b-543cd5f9bf63 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:32.151904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917881-3ab8-4019-b451-164e6f545b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:32.152752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917881-3ab8-4019-b451-164e6f545b2b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:32.153027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917881-3ab8-4019-b451-164e6f545b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:32.153306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917881-3ab8-4019-b451-164e6f545b2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:32.165349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d917881-3ab8-4019-b451-164e6f545b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6d917881-3ab8-4019-b451-164e6f545b2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:49:32.176378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:32.177962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:49:32.179036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:32.183919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 610/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:49:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:32.185748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ad407-bbf3-4a80-8066-cf411e9f0b17 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:32.367662 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ad407-bbf3-4a80-8066-cf411e9f0b17 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:32.400049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:32.414685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:32.415598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:32.415989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:32.416279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:32.417297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:32.417712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:32.419048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:32.429660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 613/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:49:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:32.437105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917881-3ab8-4019-b451-164e6f545b2b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:32.488085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:32.553233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917881-3ab8-4019-b451-164e6f545b2b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:32.597928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:32.598743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:32.599033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:32.599315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:32.611118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:32.612782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:32.634875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:32.636741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:32.646160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:32.646160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:32.646160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:32.646160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:32.646160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 611/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:32.647643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:32.767723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055eaec-eab7-4f9e-b96b-39ee18464f6a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:32.810823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:32.811577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:32.811884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:32.812178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:32.813059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:32.813602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:32.815478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:32.831109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 614/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:32.837517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:32.989810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:32.999390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f64fb-64ba-454c-8535-47f413094eff None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:33.058324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:33.059302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:33.059565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:33.059851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:33.070320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:33.071829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:49:33.103507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:33.106084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:33.114350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 612/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:33.115702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:33.178087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:33.241514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3e7c4-12ad-44a1-bdd4-35b87d08d9f4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:33.289417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:33.290109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:33.290417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:33.290689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:33.292752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:33.293115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:33.294793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:33.316800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 615/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 8 12:49:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:33.323171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:33.473209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca58d9b-e501-4a41-8c14-145e7f0da505 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:33.523781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:33.524548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:33.525003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:33.525327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:33.538302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:33.539756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:33.558881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:33.560257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:33.561727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:33.561727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:33.561727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:33.561727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:33.561727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 613/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:33.567023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:33.689601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3cf74-49b6-48d2-8701-a62530050751 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:33.692112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:33.730075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:33.731032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:33.731196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:33.731493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:33.732266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:33.732535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:33.734207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:33.747841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 616/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:33.754852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:33.769724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:33.887622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1552c85-470f-42fe-a06d-fcc25da72a0d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:33.936004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:33.936944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:33.937232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:33.937673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:33.945499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:33.949641 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:49:33.969996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:33.972558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:33.973842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 614/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:49:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:33.977896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:34.115790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e863137-08b3-46b0-ac79-bbc76d84f15f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:34.163863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0f617-14f4-4d5f-986f-36448478d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:34.164682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f617-14f4-4d5f-986f-36448478d870 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:34.165112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f617-14f4-4d5f-986f-36448478d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:34.165536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f617-14f4-4d5f-986f-36448478d870 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:34.167198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0f617-14f4-4d5f-986f-36448478d870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:34.167719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0f617-14f4-4d5f-986f-36448478d870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:34.169636 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0f617-14f4-4d5f-986f-36448478d870 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:34.190241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 617/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:49:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:34.196581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:34.273141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:34.317018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835a3c3-6f75-4fbd-907a-2cfbae9303ec None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:34.357256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91454a8a-054b-4232-90cb-0cf12eed151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:34.358189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91454a8a-054b-4232-90cb-0cf12eed151d None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:34.358470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91454a8a-054b-4232-90cb-0cf12eed151d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:34.358747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91454a8a-054b-4232-90cb-0cf12eed151d None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/a6bc294afca749e5bc2d44c65ea7f96b/roles/ea6c0a1f7c484564aacab2eb0e62eef9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:34.375430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91454a8a-054b-4232-90cb-0cf12eed151d None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=a6bc294afca749e5bc2d44c65ea7f96b, role_id=ea6c0a1f7c484564aacab2eb0e62eef9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:34.377038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91454a8a-054b-4232-90cb-0cf12eed151d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:34.392067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 615/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:49:34 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/a6bc294afca749e5bc2d44c65ea7f96b/roles/ea6c0a1f7c484564aacab2eb0e62eef9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:49:36.894684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88973998-70af-4794-9a57-8150fb755e89 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:36.895289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88973998-70af-4794-9a57-8150fb755e89 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:36.895289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88973998-70af-4794-9a57-8150fb755e89 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:36.896731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 618/1233] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:49:36.904020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ea94-6053-429b-a3bc-5ea8acdc4976 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:36.904613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ea94-6053-429b-a3bc-5ea8acdc4976 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:36.904713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ea94-6053-429b-a3bc-5ea8acdc4976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:36.927280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9722ea94-6053-429b-a3bc-5ea8acdc4976 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:36.928763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9722ea94-6053-429b-a3bc-5ea8acdc4976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:37.014677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 616/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:49:37.042643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88973998-70af-4794-9a57-8150fb755e89 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:37.084197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:37.192508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88973998-70af-4794-9a57-8150fb755e89 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:37.239612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d974b-63f8-4d4f-bd93-294cfb8abf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:37.240816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d974b-63f8-4d4f-bd93-294cfb8abf7a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:37.241202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d974b-63f8-4d4f-bd93-294cfb8abf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:37.242327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d974b-63f8-4d4f-bd93-294cfb8abf7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:37.261512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d974b-63f8-4d4f-bd93-294cfb8abf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b49d974b-63f8-4d4f-bd93-294cfb8abf7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:49:37.270817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:37.272566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:37.274043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 619/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 8 12:49:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:37.279153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722ea94-6053-429b-a3bc-5ea8acdc4976 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:37.339683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:37.410931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722ea94-6053-429b-a3bc-5ea8acdc4976 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:37.461702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:37.462347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:37.462735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:37.463099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:37.464376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:37.464812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:37.466447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:37.476632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 617/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 8 12:49:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:37.483252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d974b-63f8-4d4f-bd93-294cfb8abf7a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:37.601961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:37.629157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d974b-63f8-4d4f-bd93-294cfb8abf7a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:37.668253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:37.669144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:37.669448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:37.669803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:37.681888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:37.683701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:37.703511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:37.704707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:37.710673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:37.710673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:37.710673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:37.710673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:37.710673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 620/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:37.712245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:37.838715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f37b94-8c83-4fc9-9d9a-5d8b383538f0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:37.850998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:37.888012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:37.888862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:37.889280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:37.889642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:37.890706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:37.890998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:37.892548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:37.912923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 618/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:37.914196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:38.047230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605deb28-c87d-41f5-a769-2f80cd0daa05 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:38.093511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:38.094529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:38.094820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:38.095100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:38.098712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:38.106277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:38.108199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:49:38.127989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:38.129321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:38.130622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 621/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:38.135845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:38.263431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6bf76-f7da-4393-96a8-1818c29b8152 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:38.304708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:38.305812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:38.306103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:38.306442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:38.307975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:38.308330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:38.310266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:38.330261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 619/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 8 12:49:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:38.336174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:38.468163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71741046-49b8-4e7f-8346-a2ed4b1c33e4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:38.511710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eaadc-5d22-4ea2-a999-928ee35760e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:38.512480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eaadc-5d22-4ea2-a999-928ee35760e1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:38.512802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eaadc-5d22-4ea2-a999-928ee35760e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:38.512802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eaadc-5d22-4ea2-a999-928ee35760e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:38.586005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:38.594142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5eaadc-5d22-4ea2-a999-928ee35760e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:38.595679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5eaadc-5d22-4ea2-a999-928ee35760e1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:38.720844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 622/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:49:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 12:49:38.726705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:38.759041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:38.853652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104ab07-ca4a-46f5-8a15-1a55148059e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:38.896469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:38.897788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:38.898388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:38.898712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:38.912846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:38.914507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:38.935946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:38.936954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:38.937910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:38.937910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:38.937910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:38.937910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:38.937910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 620/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:38.943112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eaadc-5d22-4ea2-a999-928ee35760e1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:39.057217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:39.064043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eaadc-5d22-4ea2-a999-928ee35760e1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:39.112642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:39.113798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:39.114319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:39.115096 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:39.116355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:39.116920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:39.119600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:39.139177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 623/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:39.146099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:39.246328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:39.280560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592930-f113-495b-a21a-a3f75cee9dfc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:39.332651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:39.333464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:39.333779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:39.334062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:39.342797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:39.344400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:49:39.364608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:39.366062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:39.367185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 621/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:49:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:39.372969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:39.504388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc02ec-6148-41f2-87bf-d8ca52cc1bb9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:39.547312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8378d-5fb3-4aa9-a58b-5f1e84b28270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:39.547990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8378d-5fb3-4aa9-a58b-5f1e84b28270 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:39.548283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8378d-5fb3-4aa9-a58b-5f1e84b28270 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:39.548571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8378d-5fb3-4aa9-a58b-5f1e84b28270 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:39.549761 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8378d-5fb3-4aa9-a58b-5f1e84b28270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:39.550107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8378d-5fb3-4aa9-a58b-5f1e84b28270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:39.551909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8378d-5fb3-4aa9-a58b-5f1e84b28270 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:39.568611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 624/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:49:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:39.575075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:39.695761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de241-d734-4f2b-a372-f11314101f2b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:39.749141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ef62f-2ac9-414c-b375-5acf09d1b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:39.750296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ef62f-2ac9-414c-b375-5acf09d1b57d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:39.750764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ef62f-2ac9-414c-b375-5acf09d1b57d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:39.751062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ef62f-2ac9-414c-b375-5acf09d1b57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:39.752115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ef62f-2ac9-414c-b375-5acf09d1b57d None admin] RBAC: Adding query filter params (role.id=ea6c0a1f7c484564aacab2eb0e62eef9, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=a6bc294afca749e5bc2d44c65ea7f96b) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:39.752608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ef62f-2ac9-414c-b375-5acf09d1b57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:39.754264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ef62f-2ac9-414c-b375-5acf09d1b57d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:39.762354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 622/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:49:39 2022] GET /identity/v3/role_assignments?user.id=a6bc294afca749e5bc2d44c65ea7f96b&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=ea6c0a1f7c484564aacab2eb0e62eef9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:42.252247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d2ac4-024b-46b0-a5bb-9d83abe1de2f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:42.252827 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d2ac4-024b-46b0-a5bb-9d83abe1de2f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:42.252929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d2ac4-024b-46b0-a5bb-9d83abe1de2f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:42.254377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 625/1247] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:49:42.261265 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdccaf-1b69-4893-a81a-249ef5370418 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:42.261951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdccaf-1b69-4893-a81a-249ef5370418 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:42.261951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdccaf-1b69-4893-a81a-249ef5370418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:42.272075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:42.285977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-18bdccaf-1b69-4893-a81a-249ef5370418 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:42.287180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18bdccaf-1b69-4893-a81a-249ef5370418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:42.376562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 623/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:49:42.404417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d2ac4-024b-46b0-a5bb-9d83abe1de2f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:42.425888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:42.538576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d2ac4-024b-46b0-a5bb-9d83abe1de2f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:42.580161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8feae-cfa0-47ce-9b07-85981807a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:42.581217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8feae-cfa0-47ce-9b07-85981807a36a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:42.581329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8feae-cfa0-47ce-9b07-85981807a36a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:42.581575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8feae-cfa0-47ce-9b07-85981807a36a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:42.597680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8feae-cfa0-47ce-9b07-85981807a36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-98b8feae-cfa0-47ce-9b07-85981807a36a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:49:42.606256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:42.607612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:42.608647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 626/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:49:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:42.614147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdccaf-1b69-4893-a81a-249ef5370418 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:42.743921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdccaf-1b69-4893-a81a-249ef5370418 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:42.778695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:42.789227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:42.789961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:42.790569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:42.790880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:42.791732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:42.792352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:42.794090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:42.811781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 624/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:49:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:42.813511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8feae-cfa0-47ce-9b07-85981807a36a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:42.913181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:42.942027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8feae-cfa0-47ce-9b07-85981807a36a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:42.993017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:42.993871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:42.995336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:42.995336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:43.011881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:43.013663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:43.040298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:43.041303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:43.042406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:43.042406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:43.042406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:43.042406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:43.042406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 627/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:43.048455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:43.201294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22999c34-0540-4707-9844-a692ee5af708 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:43.243181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:43.243862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:43.244255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:43.245208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:43.245429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:43.245772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:43.247326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:43.263427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 625/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:49:43.271000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:43.416724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44dbc3-0f1f-415a-b1c3-556ea5e0f288 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:43.449836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:43.458690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:43.459502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:43.459792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:43.460078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:43.468754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:43.470549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:49:43.487824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:43.489136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:43.490924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 628/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:43.496909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:43.565394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:43.619677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749ea1-f601-46c0-8f4b-f8e06a828199 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:43.665891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:43.667226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:43.667719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:43.668016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:43.668884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:43.669200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:43.670704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:43.694868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 626/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 8 12:49:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:43.701719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:43.831392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920be75-6047-4f43-917d-7655cc121354 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:43.880813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae36184-2bd7-4b75-a8a3-c7708a0efb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:43.881601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae36184-2bd7-4b75-a8a3-c7708a0efb80 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:43.882092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae36184-2bd7-4b75-a8a3-c7708a0efb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:43.882499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae36184-2bd7-4b75-a8a3-c7708a0efb80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:43.958245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:43.973819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae36184-2bd7-4b75-a8a3-c7708a0efb80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:43.975330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae36184-2bd7-4b75-a8a3-c7708a0efb80 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:44.115186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 629/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:49:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 12:49:44.122351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:44.240601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f148d15-b47f-4f1b-bd15-95c5caa46e17 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:44.256920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:44.287110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:44.288599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:44.289132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:44.289659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:44.308349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:44.310010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:44.330662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:44.331955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:44.333086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:44.333086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:44.333086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:44.333086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:44.333086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 627/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:44.338245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae36184-2bd7-4b75-a8a3-c7708a0efb80 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:44.443048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:44.458725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae36184-2bd7-4b75-a8a3-c7708a0efb80 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:44.497378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:44.498042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:44.498395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:44.498601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:44.499419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:44.499803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:44.501452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:44.517786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 630/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:44.523401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:44.644222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf6b6b-cae4-4e27-a03f-dc62ef0ae261 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:44.690661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:44.691550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:44.691912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:44.692195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:44.700233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:44.701737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:49:44.718477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:44.719932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:44.720914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:49:44.720914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:49:44.720914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:49:44.720914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:49:44.720914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:49:44.720914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:49:44.720914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:44.720914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:44.725459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 628/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:44.726530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:44.857069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc136af-b0fb-4d01-96a8-d1712ec7da6b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:44.903124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4e428-0b46-497a-b831-c878d691c497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:44.903945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e428-0b46-497a-b831-c878d691c497 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:44.904229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e428-0b46-497a-b831-c878d691c497 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:44.904523 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e428-0b46-497a-b831-c878d691c497 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:44.905336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4e428-0b46-497a-b831-c878d691c497 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:44.905680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4e428-0b46-497a-b831-c878d691c497 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:44.907425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4e428-0b46-497a-b831-c878d691c497 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:44.921264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 631/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:49:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:49:44.928416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:44.964180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:45.073819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdadc2-2750-4789-b570-50c047d7012c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:45.131237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b4b7-a788-47a1-b6a8-efb69e39318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:45.132058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b4b7-a788-47a1-b6a8-efb69e39318a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:45.132356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b4b7-a788-47a1-b6a8-efb69e39318a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:45.132711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b4b7-a788-47a1-b6a8-efb69e39318a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:45.133944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b4b7-a788-47a1-b6a8-efb69e39318a None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=a6bc294afca749e5bc2d44c65ea7f96b) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:45.134368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b4b7-a788-47a1-b6a8-efb69e39318a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:45.137082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b4b7-a788-47a1-b6a8-efb69e39318a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:45.144525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 629/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:49:44 2022] GET /identity/v3/role_assignments?user.id=a6bc294afca749e5bc2d44c65ea7f96b&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:47.502628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d3fe-aab5-4875-ae60-f0a5ec1d85e7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:47.503183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d3fe-aab5-4875-ae60-f0a5ec1d85e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:47.503183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d3fe-aab5-4875-ae60-f0a5ec1d85e7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:47.504551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 632/1261] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:49:47.510115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67a84f-fed7-412f-bb28-81a99a18eb48 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:47.510543 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67a84f-fed7-412f-bb28-81a99a18eb48 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:47.510691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67a84f-fed7-412f-bb28-81a99a18eb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:47.527878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ed67a84f-fed7-412f-bb28-81a99a18eb48 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:47.529081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed67a84f-fed7-412f-bb28-81a99a18eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:47.597743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 630/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:49:47.621926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341d3fe-aab5-4875-ae60-f0a5ec1d85e7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:47.632905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:47.724931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341d3fe-aab5-4875-ae60-f0a5ec1d85e7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:47.757923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6f7e7-bf26-4471-a4bc-b2740be455ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:47.758713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6f7e7-bf26-4471-a4bc-b2740be455ac None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:47.759001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6f7e7-bf26-4471-a4bc-b2740be455ac None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:47.759281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6f7e7-bf26-4471-a4bc-b2740be455ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:47.769907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6f7e7-bf26-4471-a4bc-b2740be455ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-39e6f7e7-bf26-4471-a4bc-b2740be455ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:49:47.777515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:47.778711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:47.779887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 633/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:49:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:47.784699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67a84f-fed7-412f-bb28-81a99a18eb48 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:47.803443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:47.884167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67a84f-fed7-412f-bb28-81a99a18eb48 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:47.920302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:47.920982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:47.921299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:47.921610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:47.922371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:47.922687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:47.924074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:47.933598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 631/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:49:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:47.939446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6f7e7-bf26-4471-a4bc-b2740be455ac None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:48.006325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:48.042335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6f7e7-bf26-4471-a4bc-b2740be455ac None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:48.079325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:48.080262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:48.080694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:48.080954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:48.095872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:48.097777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:48.120517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:48.121724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:48.122806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:48.122806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:48.122806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:48.122806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:48.122806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 634/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:49:48.128399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:48.213856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:48.233474 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8485-2e88-49e3-acdc-007c52afa863 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:48.267442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:48.268023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:48.268306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:48.268584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:48.269316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:48.269647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:48.271007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:48.283335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 632/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:48.289001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:48.392438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967fc64-c538-417e-8d8b-7441a732000b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:48.411723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:48.426550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:48.427356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:48.427644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:48.427925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:48.436323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:48.437809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:49:48.452242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:48.453349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:48.454565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 635/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:48.459301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:48.563240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405bc7c-df83-4955-93d7-3f42a7e4764b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:48.615746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:48.616417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:48.616702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:48.616981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:48.617836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:48.618145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:48.620209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:48.628612 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:48.637802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 633/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 8 12:49:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:48.643399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:48.747970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0876e2-cbe3-439a-a94e-c23432c01fe5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:48.784388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:48.785200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:48.785492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:48.785800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:48.799432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:48.800926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:48.819833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:48.821227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:48.822435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:48.822435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:48.822435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:48.822435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:48.822435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 636/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:48.828232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:48.950207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366bcc-edb3-4ecd-b639-b56acb59d75f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:48.986105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:48.986768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:48.987060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:48.987345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:48.988074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:48.988390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:48.990040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:49.002515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 634/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:49.008299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:49.039880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:49.116277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fe16b-9b56-4f07-b3f6-d0627f6eefe3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:49.150477 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:49.151359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:49.151650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:49.151935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:49.158697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:49.160158 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:49:49.175022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:49.176198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:49.177326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 637/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:49:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:49.182924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:49.247382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:49.290014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d14acf-8a60-4a15-86e3-f762009cb112 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:49.322996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388eb93-ef28-4cfc-bac1-005267cc529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:49.323654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388eb93-ef28-4cfc-bac1-005267cc529d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:49.323938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388eb93-ef28-4cfc-bac1-005267cc529d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:49.324217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388eb93-ef28-4cfc-bac1-005267cc529d None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:49.325000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388eb93-ef28-4cfc-bac1-005267cc529d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:49.325310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388eb93-ef28-4cfc-bac1-005267cc529d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:49.326800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388eb93-ef28-4cfc-bac1-005267cc529d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:49.339041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 635/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:49.345007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:49.436840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:49.446108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6605a88-b822-40a5-b41a-e8a62bcb0069 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:49.480491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3754d-1fb4-44b5-b6bb-16b4ed9082a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:49.481382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3754d-1fb4-44b5-b6bb-16b4ed9082a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:49.481707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3754d-1fb4-44b5-b6bb-16b4ed9082a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:49.481996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3754d-1fb4-44b5-b6bb-16b4ed9082a0 None admin] PATH_INFO: `/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/a6bc294afca749e5bc2d44c65ea7f96b/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:49.483966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3754d-1fb4-44b5-b6bb-16b4ed9082a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=69a7c05667c74db9a7d7a8310d11fc9d, user_id=a6bc294afca749e5bc2d44c65ea7f96b, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:49.485420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3754d-1fb4-44b5-b6bb-16b4ed9082a0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:49.498993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 638/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 8 12:49:49 2022] PUT /identity/v3/projects/69a7c05667c74db9a7d7a8310d11fc9d/users/a6bc294afca749e5bc2d44c65ea7f96b/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:49:51.778220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa8a1-621f-479a-9a2c-704508375750 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:51.778715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa8a1-621f-479a-9a2c-704508375750 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:51.778715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa8a1-621f-479a-9a2c-704508375750 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:51.780079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 636/1274] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:49:51.785157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a08f1-3c0d-460e-8420-fe50cc68f678 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:51.785572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a08f1-3c0d-460e-8420-fe50cc68f678 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:51.785754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a08f1-3c0d-460e-8420-fe50cc68f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:51.802272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a60a08f1-3c0d-460e-8420-fe50cc68f678 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:51.803455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a60a08f1-3c0d-460e-8420-fe50cc68f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:51.873124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 639/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:49:51.897367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aa8a1-621f-479a-9a2c-704508375750 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:52.006254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aa8a1-621f-479a-9a2c-704508375750 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:52.023624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:52.041719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ffbc2-93bf-42ce-b0fa-d92a0ae66b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:52.042445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ffbc2-93bf-42ce-b0fa-d92a0ae66b9f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:52.042728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ffbc2-93bf-42ce-b0fa-d92a0ae66b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:52.043004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ffbc2-93bf-42ce-b0fa-d92a0ae66b9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:52.053024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ffbc2-93bf-42ce-b0fa-d92a0ae66b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c13ffbc2-93bf-42ce-b0fa-d92a0ae66b9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 12:49:52.061662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:52.062835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:52.063892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 637/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 8 12:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 12:49:52.068864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a08f1-3c0d-460e-8420-fe50cc68f678 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:52.164628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:52.184419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a08f1-3c0d-460e-8420-fe50cc68f678 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:52.217641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:52.218306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:52.218591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:52.218879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:52.219617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:52.219927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:52.221293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:52.230153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 640/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 8 12:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:52.235832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ffbc2-93bf-42ce-b0fa-d92a0ae66b9f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:52.336119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ffbc2-93bf-42ce-b0fa-d92a0ae66b9f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:52.371641 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:52.372443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:52.372728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:52.373006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:52.383545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:52.385144 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:52.402652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:52.403790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:52.404762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:52.404762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:52.404762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:52.404762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:52.404762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 638/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:52.409849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:52.512225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b2959-4b59-4790-8232-b98275b01eea None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:52.548840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:52.549513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:52.549841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:52.550130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:52.550866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:52.551184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:52.552578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:52.565470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 641/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:52.571427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:52.602633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:52.670446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b747-8e91-4815-9bdb-f314fa61240f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:52.702719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:52.703516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:52.703805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:52.704113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:52.711286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:52.713279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 12:49:52.727140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:52.728276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:52.729432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 639/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:52.734333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:52.738105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:52.831210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa8cfd-b7fb-4392-a329-f8315b7c4b3f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:52.864049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:52.864903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:52.865201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:52.865485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:52.866345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:52.866659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:52.868085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:52.886674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 642/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 8 12:49:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:52.892441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:52.991819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:53.002779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70113ce4-1604-48ab-984e-370d45066cdd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:53.038967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c874b-2ed5-4f9d-94bf-edda4ad6022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:53.039612 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c874b-2ed5-4f9d-94bf-edda4ad6022d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:53.039898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c874b-2ed5-4f9d-94bf-edda4ad6022d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:53.040179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c874b-2ed5-4f9d-94bf-edda4ad6022d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:53.119219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c874b-2ed5-4f9d-94bf-edda4ad6022d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:53.120818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c874b-2ed5-4f9d-94bf-edda4ad6022d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:53.213903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:53.224597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 640/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 8 12:49:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 12:49:53.230854 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:53.296580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:53.335893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b168-2d50-4f11-8931-03f3ae6e72be None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:53.370826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:53.371544 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:53.371830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:53.372109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:53.382445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:53.383905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 12:49:53.402014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:53.403153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:53.404333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 12:49:53.404333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 12:49:53.404333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 12:49:53.404333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:53.404333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 643/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:53.409140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c874b-2ed5-4f9d-94bf-edda4ad6022d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:53.509755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c874b-2ed5-4f9d-94bf-edda4ad6022d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:53.543544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:53.544205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:53.544493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:53.544773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:53.545496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:53.545838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:53.547222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:53.558959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 641/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 8 12:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:53.564538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:53.661569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72872-1d41-4855-a65e-2a5e1d618c2d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:53.676093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:53.696971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:53.697861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:53.698147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:53.698425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:53.705034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:53.706513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 12:49:53.720912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:53.722077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jun 08 12:49:53.723179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 644/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 8 12:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:53.728161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:53.778919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:53.832133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd73f4-b8a2-47f3-8f6c-e14802f9dfc7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:53.866538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f379-b484-434f-9b34-baf2bc599eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:53.867206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f379-b484-434f-9b34-baf2bc599eff None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:53.867498 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f379-b484-434f-9b34-baf2bc599eff None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:53.867784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f379-b484-434f-9b34-baf2bc599eff None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:53.868656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f379-b484-434f-9b34-baf2bc599eff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:53.868977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f379-b484-434f-9b34-baf2bc599eff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:53.870451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f379-b484-434f-9b34-baf2bc599eff None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:53.882527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 642/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 8 12:49:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:53.889160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:53.999982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592bc68-dfa4-4b05-aef7-8403acb0cba4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:54.033231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c72a39-0edc-4ea9-a5c1-320f19416b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:54.033919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c72a39-0edc-4ea9-a5c1-320f19416b69 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:54.034214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c72a39-0edc-4ea9-a5c1-320f19416b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:54.034499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c72a39-0edc-4ea9-a5c1-320f19416b69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:54.035338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c72a39-0edc-4ea9-a5c1-320f19416b69 None admin] RBAC: Adding query filter params (role.id=4343857f7f764235b4cb9f4f7de7c235, scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d, user.id=a6bc294afca749e5bc2d44c65ea7f96b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:54.035659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c72a39-0edc-4ea9-a5c1-320f19416b69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:54.037110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c72a39-0edc-4ea9-a5c1-320f19416b69 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:54.043708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 645/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 8 12:49:53 2022] GET /identity/v3/role_assignments?user.id=a6bc294afca749e5bc2d44c65ea7f96b&scope.project.id=69a7c05667c74db9a7d7a8310d11fc9d&role.id=4343857f7f764235b4cb9f4f7de7c235 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:56.348256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe778c1-4069-46c9-ae90-f22abeb77546 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:56.348786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe778c1-4069-46c9-ae90-f22abeb77546 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:56.348786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe778c1-4069-46c9-ae90-f22abeb77546 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:56.350222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 643/1288] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:49:56.356319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118be3a-895f-4bae-928f-d81508e5e57f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:56.356736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118be3a-895f-4bae-928f-d81508e5e57f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:56.356877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118be3a-895f-4bae-928f-d81508e5e57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:56.374535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0118be3a-895f-4bae-928f-d81508e5e57f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:56.375729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0118be3a-895f-4bae-928f-d81508e5e57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:56.404368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:56.444475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 646/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:49:56.466510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe778c1-4069-46c9-ae90-f22abeb77546 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:56.567517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe778c1-4069-46c9-ae90-f22abeb77546 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:56.580676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:56.606042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:56.606752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:56.607039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:56.607322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:56.608018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:56.609379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:49:56.622644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:49:56.623983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:49:56.625054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 644/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:49:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:49:56.630053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118be3a-895f-4bae-928f-d81508e5e57f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:56.773528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118be3a-895f-4bae-928f-d81508e5e57f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:56.823085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebc263-a1cc-4872-b54a-5410f0d7ae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:56.824004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebc263-a1cc-4872-b54a-5410f0d7ae8c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:56.824425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebc263-a1cc-4872-b54a-5410f0d7ae8c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:56.824840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebc263-a1cc-4872-b54a-5410f0d7ae8c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:56.825956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebc263-a1cc-4872-b54a-5410f0d7ae8c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:56.826392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebc263-a1cc-4872-b54a-5410f0d7ae8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:56.828486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebc263-a1cc-4872-b54a-5410f0d7ae8c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:56.835968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 647/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Jun 8 12:49:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:56.842069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:56.962920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea928-7f93-4d15-890f-db04fb029409 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:57.018916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad067b-79b0-4e4a-a167-c18b0f90044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:57.019597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad067b-79b0-4e4a-a167-c18b0f90044c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:57.019919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad067b-79b0-4e4a-a167-c18b0f90044c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:57.020267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad067b-79b0-4e4a-a167-c18b0f90044c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:57.021151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad067b-79b0-4e4a-a167-c18b0f90044c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:49:57.021576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad067b-79b0-4e4a-a167-c18b0f90044c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:57.023310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad067b-79b0-4e4a-a167-c18b0f90044c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:57.028909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 645/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Jun 8 12:49:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:49:59.299471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1a8c-93fe-44c8-b9be-540eea5e0f61 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:59.300030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1a8c-93fe-44c8-b9be-540eea5e0f61 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:59.300030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1a8c-93fe-44c8-b9be-540eea5e0f61 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:59.301508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 648/1293] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:49:59.307208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325f161-6e47-489a-92bd-2529e53f004f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:59.307695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325f161-6e47-489a-92bd-2529e53f004f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:59.307986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325f161-6e47-489a-92bd-2529e53f004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:59.329706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a325f161-6e47-489a-92bd-2529e53f004f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:49:59.330921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a325f161-6e47-489a-92bd-2529e53f004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:49:59.361209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:59.400329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 646/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:49:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 12:49:59.424153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa1a8c-93fe-44c8-b9be-540eea5e0f61 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:49:59.455368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:49:59.526317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa1a8c-93fe-44c8-b9be-540eea5e0f61 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:49:59.560250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad4eae-3a42-4a59-a232-c67aef55cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:49:59.560909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4eae-3a42-4a59-a232-c67aef55cb70 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:49:59.561210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4eae-3a42-4a59-a232-c67aef55cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:49:59.561495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4eae-3a42-4a59-a232-c67aef55cb70 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:49:59.562255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad4eae-3a42-4a59-a232-c67aef55cb70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:49:59.563646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad4eae-3a42-4a59-a232-c67aef55cb70 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:49:59.577602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 649/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 8 12:49:59 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:50:01.833915 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778a3c0-8732-4fd4-b8e1-6a0c6bd14583 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:01.834435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778a3c0-8732-4fd4-b8e1-6a0c6bd14583 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:01.834529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778a3c0-8732-4fd4-b8e1-6a0c6bd14583 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:01.835889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 647/1296] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:50:01.841930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042aff9-773a-4dec-afce-79dee445cd76 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:01.842374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042aff9-773a-4dec-afce-79dee445cd76 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:01.842493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042aff9-773a-4dec-afce-79dee445cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:01.859698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2042aff9-773a-4dec-afce-79dee445cd76 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:50:01.860898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2042aff9-773a-4dec-afce-79dee445cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:50:01.937523 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 650/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:50:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:50:01.961581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778a3c0-8732-4fd4-b8e1-6a0c6bd14583 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:50:02.082902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778a3c0-8732-4fd4-b8e1-6a0c6bd14583 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:50:02.118707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:50:02.119468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:02.119758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:02.120031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:02.120698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:50:02.122129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:50:02.135109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:50:02.136782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:50:02.137740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 648/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:50:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:50:02.143008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042aff9-773a-4dec-afce-79dee445cd76 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:50:02.162043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:50:02.246630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042aff9-773a-4dec-afce-79dee445cd76 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:50:02.279681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:50:02.280347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:02.280638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:02.280924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:02.281670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:50:02.281993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:50:02.283378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:50:02.288494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 651/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Jun 8 12:50:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:50:02.294457 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:50:02.333611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:50:02.418716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e36e-b76b-4b0c-8079-030dd0744988 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:50:02.451555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde5259-f351-40ed-bf0d-2150ce2eb90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:50:02.452209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde5259-f351-40ed-bf0d-2150ce2eb90c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:02.452499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde5259-f351-40ed-bf0d-2150ce2eb90c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:02.452783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde5259-f351-40ed-bf0d-2150ce2eb90c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:02.453597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde5259-f351-40ed-bf0d-2150ce2eb90c None admin] RBAC: Adding query filter params (interface=public, service_id=85dca588e01d4b88aae4c87f5ff90e9e, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:50:02.453918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde5259-f351-40ed-bf0d-2150ce2eb90c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:50:02.455282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde5259-f351-40ed-bf0d-2150ce2eb90c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:50:02.460154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 649/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 8 12:50:02 2022] GET /identity/v3/endpoints?service_id=85dca588e01d4b88aae4c87f5ff90e9e&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:50:02.465819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:50:02.544945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:50:02.563694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab575-30e9-4b99-9976-27f5c550dc65 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:50:02.597381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c539048-c3ef-4fd9-9300-76128603e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:50:02.598088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c539048-c3ef-4fd9-9300-76128603e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:02.598374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c539048-c3ef-4fd9-9300-76128603e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:02.598659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c539048-c3ef-4fd9-9300-76128603e5f2 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:02.599346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c539048-c3ef-4fd9-9300-76128603e5f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:50:02.600744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c539048-c3ef-4fd9-9300-76128603e5f2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:50:02.608215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 652/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 8 12:50:02 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:50:04.876523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0843-ad52-41b1-aa74-d3c05181bb17 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:04.877049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0843-ad52-41b1-aa74-d3c05181bb17 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:04.877146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0843-ad52-41b1-aa74-d3c05181bb17 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:04.878473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 650/1302] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:50:04.883575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e11a7-ddc3-44db-a8ac-6a7b6e1b6596 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:04.884479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e11a7-ddc3-44db-a8ac-6a7b6e1b6596 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:04.884703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e11a7-ddc3-44db-a8ac-6a7b6e1b6596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:04.901964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4a6e11a7-ddc3-44db-a8ac-6a7b6e1b6596 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:50:04.903165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4a6e11a7-ddc3-44db-a8ac-6a7b6e1b6596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:50:04.970643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 653/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:50:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 12:50:04.994467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe0843-ad52-41b1-aa74-d3c05181bb17 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:50:05.090985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:50:05.098088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe0843-ad52-41b1-aa74-d3c05181bb17 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:50:05.132405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:50:05.133122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:05.133412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:05.134339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:05.135003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:50:05.136389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 12:50:05.148285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 12:50:05.149512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jun 08 12:50:05.150942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 651/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 8 12:50:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 12:50:05.155676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e11a7-ddc3-44db-a8ac-6a7b6e1b6596 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:50:05.230367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:50:05.254541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e11a7-ddc3-44db-a8ac-6a7b6e1b6596 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:50:05.288285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ba71-eb58-46c6-924a-16d78da1ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:50:05.288954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ba71-eb58-46c6-924a-16d78da1ff6e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:05.289237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ba71-eb58-46c6-924a-16d78da1ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:05.289513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ba71-eb58-46c6-924a-16d78da1ff6e None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:05.291051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ba71-eb58-46c6-924a-16d78da1ff6e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:50:05.291282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ba71-eb58-46c6-924a-16d78da1ff6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:50:05.292658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ba71-eb58-46c6-924a-16d78da1ff6e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:50:05.297748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 654/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Jun 8 12:50:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:50:05.303606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:50:05.411155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9147e-efa3-4cd0-a319-d659983cbab8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:50:05.444989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd36cb9-b365-433d-af6a-524e5474625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:50:05.445706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36cb9-b365-433d-af6a-524e5474625c None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:50:05.446002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36cb9-b365-433d-af6a-524e5474625c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:50:05.447069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36cb9-b365-433d-af6a-524e5474625c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:50:05.447833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd36cb9-b365-433d-af6a-524e5474625c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:50:05.449224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd36cb9-b365-433d-af6a-524e5474625c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:50:05.467878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 652/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 8 12:50:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:50:15.294739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=30 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:50:15.463749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:13.246194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005efa7-6e89-4514-a63d-ed1291dda95a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:13.247276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005efa7-6e89-4514-a63d-ed1291dda95a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:13.247972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005efa7-6e89-4514-a63d-ed1291dda95a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:13.250720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 655/1307] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:13.255806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db79961-aa4c-4e6c-9360-99658a9f2d54 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:13.256213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db79961-aa4c-4e6c-9360-99658a9f2d54 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:13.256424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db79961-aa4c-4e6c-9360-99658a9f2d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:13.379990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5db79961-aa4c-4e6c-9360-99658a9f2d54 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:13.381439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5db79961-aa4c-4e6c-9360-99658a9f2d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:13.516863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 653/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:13.567296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15525b2c-c939-400d-93bb-7107ec62fc33 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:13.567605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15525b2c-c939-400d-93bb-7107ec62fc33 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:13.567868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15525b2c-c939-400d-93bb-7107ec62fc33 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:13.570102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 656/1309] 10.222.0.46 () {54 vars in 964 bytes} [Wed Jun 8 12:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:13.577914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2087fd-38fb-40cd-956d-e23f5eb7b693 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:13.578231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2087fd-38fb-40cd-956d-e23f5eb7b693 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:13.578765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2087fd-38fb-40cd-956d-e23f5eb7b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:13.688834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4f2087fd-38fb-40cd-956d-e23f5eb7b693 None None] MFA Rules not processed for user `98d7ac35d0e846af97f3ca345ec2ac09`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:13.690500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4f2087fd-38fb-40cd-956d-e23f5eb7b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:13.715919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:13.783254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 654/1310] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Jun 8 12:51:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:13.793193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15525b2c-c939-400d-93bb-7107ec62fc33 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:13.795071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15525b2c-c939-400d-93bb-7107ec62fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:13.938027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15525b2c-c939-400d-93bb-7107ec62fc33 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:14.030197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b77f9-f623-46e5-8773-14022ac2f5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:14.031260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b77f9-f623-46e5-8773-14022ac2f5ae service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:14.031752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b77f9-f623-46e5-8773-14022ac2f5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:14.032248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b77f9-f623-46e5-8773-14022ac2f5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:14.034162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-974b77f9-f623-46e5-8773-14022ac2f5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:14.107469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:14.176607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b77f9-f623-46e5-8773-14022ac2f5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:14.178227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b77f9-f623-46e5-8773-14022ac2f5ae service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:14.201361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 657/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:16.917301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d940cd-09c0-49d4-877e-67b874e02f9c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:16.917925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d940cd-09c0-49d4-877e-67b874e02f9c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:16.917925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d940cd-09c0-49d4-877e-67b874e02f9c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:16.923401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 655/1312] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:16.925021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09bca7-b7d5-4587-a3d9-4fdd14913e1f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:16.925462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09bca7-b7d5-4587-a3d9-4fdd14913e1f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:16.925680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09bca7-b7d5-4587-a3d9-4fdd14913e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:17.018055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8d09bca7-b7d5-4587-a3d9-4fdd14913e1f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:17.019625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8d09bca7-b7d5-4587-a3d9-4fdd14913e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:17.142889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 658/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:17.182731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d940cd-09c0-49d4-877e-67b874e02f9c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:17.184504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-73d940cd-09c0-49d4-877e-67b874e02f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:17.312725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d940cd-09c0-49d4-877e-67b874e02f9c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:17.399692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:17.402767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3703d-678b-433a-83c4-e095bfdbc729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:17.403453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3703d-678b-433a-83c4-e095bfdbc729 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:17.404448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3703d-678b-433a-83c4-e095bfdbc729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:17.405287 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3703d-678b-433a-83c4-e095bfdbc729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:17.409701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4fa3703d-678b-433a-83c4-e095bfdbc729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:17.537918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3703d-678b-433a-83c4-e095bfdbc729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:17.540470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3703d-678b-433a-83c4-e095bfdbc729 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:17.561496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 656/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:20.297108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c577-fe91-4772-8025-94e43ce27b81 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:20.297637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c577-fe91-4772-8025-94e43ce27b81 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:20.297637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c577-fe91-4772-8025-94e43ce27b81 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:20.298983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 659/1315] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:20.304500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d87166-6173-4429-a56e-8215d30d3eac None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:20.304987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d87166-6173-4429-a56e-8215d30d3eac None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:20.305080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d87166-6173-4429-a56e-8215d30d3eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:20.371742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b3d87166-6173-4429-a56e-8215d30d3eac None None] MFA Rules not processed for user `6d4c968bc8d646f3a5194fd6e06e5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:20.372970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b3d87166-6173-4429-a56e-8215d30d3eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:20.430849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:20.481582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 657/1316] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:51:20.537750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36d676-2766-4c50-a5cd-2647b329ac6d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:20.538121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36d676-2766-4c50-a5cd-2647b329ac6d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:20.538403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36d676-2766-4c50-a5cd-2647b329ac6d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:20.539787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 660/1317] 10.222.0.46 () {54 vars in 964 bytes} [Wed Jun 8 12:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:20.545940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e64d4-90ea-4170-8f52-761aa6108131 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:20.546233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e64d4-90ea-4170-8f52-761aa6108131 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:20.546520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e64d4-90ea-4170-8f52-761aa6108131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:20.623686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-415e64d4-90ea-4170-8f52-761aa6108131 None None] MFA Rules not processed for user `98d7ac35d0e846af97f3ca345ec2ac09`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:20.624924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-415e64d4-90ea-4170-8f52-761aa6108131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:20.710785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 658/1318] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Jun 8 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:20.720588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36d676-2766-4c50-a5cd-2647b329ac6d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:20.722418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1d36d676-2766-4c50-a5cd-2647b329ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:20.738578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:20.847244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36d676-2766-4c50-a5cd-2647b329ac6d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:20.927229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cece60-2b68-4d3b-8c63-a0156d271c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:20.927858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cece60-2b68-4d3b-8c63-a0156d271c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:20.928182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cece60-2b68-4d3b-8c63-a0156d271c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:20.928489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cece60-2b68-4d3b-8c63-a0156d271c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:20.930298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-77cece60-2b68-4d3b-8c63-a0156d271c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:21.003431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:21.053083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cece60-2b68-4d3b-8c63-a0156d271c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:21.054746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cece60-2b68-4d3b-8c63-a0156d271c4b service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:21.074270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 661/1319] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:24.395632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edabd5-9da4-477d-9526-6d68fdb0f34f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:24.396223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edabd5-9da4-477d-9526-6d68fdb0f34f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:24.396223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edabd5-9da4-477d-9526-6d68fdb0f34f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:24.398168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 659/1320] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:51:24.404540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041235-3e99-4e4f-98a2-7abad55dfe75 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:24.405021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041235-3e99-4e4f-98a2-7abad55dfe75 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:24.405121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041235-3e99-4e4f-98a2-7abad55dfe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:24.479729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f5041235-3e99-4e4f-98a2-7abad55dfe75 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:24.480959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f5041235-3e99-4e4f-98a2-7abad55dfe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:24.583407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 662/1321] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:24.623046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edabd5-9da4-477d-9526-6d68fdb0f34f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:24.624594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-87edabd5-9da4-477d-9526-6d68fdb0f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:24.683708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:24.739892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edabd5-9da4-477d-9526-6d68fdb0f34f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:24.816714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2a84-7daa-4afb-9acd-e65020907d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:24.817490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2a84-7daa-4afb-9acd-e65020907d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:24.817810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2a84-7daa-4afb-9acd-e65020907d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:24.818094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2a84-7daa-4afb-9acd-e65020907d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:24.821160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-351d2a84-7daa-4afb-9acd-e65020907d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:24.921076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:24.937603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d2a84-7daa-4afb-9acd-e65020907d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:24.939033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d2a84-7daa-4afb-9acd-e65020907d99 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:24.957889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 660/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:28.094114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f752-2d4f-40ce-8be8-e1566aad8e1c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:28.094659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f752-2d4f-40ce-8be8-e1566aad8e1c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:28.094774 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f752-2d4f-40ce-8be8-e1566aad8e1c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:28.096464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 663/1323] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:28.103808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356220c3-33f1-4b00-9497-a7d52c9bcb7c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:28.104464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356220c3-33f1-4b00-9497-a7d52c9bcb7c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:28.104695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356220c3-33f1-4b00-9497-a7d52c9bcb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:28.177828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-356220c3-33f1-4b00-9497-a7d52c9bcb7c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:28.179343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-356220c3-33f1-4b00-9497-a7d52c9bcb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:28.283232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 661/1324] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:51:28.320289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198f752-2d4f-40ce-8be8-e1566aad8e1c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:28.321959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a198f752-2d4f-40ce-8be8-e1566aad8e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:28.343304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:28.441583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198f752-2d4f-40ce-8be8-e1566aad8e1c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:28.526215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbc7a-ce43-4875-add9-43058f7f151e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:28.526880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbc7a-ce43-4875-add9-43058f7f151e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:28.527166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbc7a-ce43-4875-add9-43058f7f151e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:28.527445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbc7a-ce43-4875-add9-43058f7f151e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:28.529100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-314cbc7a-ce43-4875-add9-43058f7f151e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:28.611841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:28.654895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cbc7a-ce43-4875-add9-43058f7f151e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:28.656406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cbc7a-ce43-4875-add9-43058f7f151e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:28.677779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 664/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:31.111658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803ef4-556f-478c-a11d-dfb533140931 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:31.112229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803ef4-556f-478c-a11d-dfb533140931 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:31.112325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803ef4-556f-478c-a11d-dfb533140931 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:31.113722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 662/1326] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:31.120207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4d2d-1e07-42d8-839e-4535691b98a7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:31.120675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4d2d-1e07-42d8-839e-4535691b98a7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:31.120787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c4d2d-1e07-42d8-839e-4535691b98a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:31.193104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-783c4d2d-1e07-42d8-839e-4535691b98a7 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:31.195043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-783c4d2d-1e07-42d8-839e-4535691b98a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:31.309100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 665/1327] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:31.344900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92803ef4-556f-478c-a11d-dfb533140931 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:31.346545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-92803ef4-556f-478c-a11d-dfb533140931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:31.414191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:31.459854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92803ef4-556f-478c-a11d-dfb533140931 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:31.534950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529e6d4-f7c8-41ee-abd5-a83f4ce17d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:31.535609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e6d4-f7c8-41ee-abd5-a83f4ce17d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:31.535894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e6d4-f7c8-41ee-abd5-a83f4ce17d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:31.536173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e6d4-f7c8-41ee-abd5-a83f4ce17d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:31.538561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4529e6d4-f7c8-41ee-abd5-a83f4ce17d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:31.662303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:31.664878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529e6d4-f7c8-41ee-abd5-a83f4ce17d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:31.666686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529e6d4-f7c8-41ee-abd5-a83f4ce17d19 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:31.687375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 663/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:34.098287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7bf2d-0ec9-41a4-ae08-5890d27ce01f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:34.098860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7bf2d-0ec9-41a4-ae08-5890d27ce01f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:34.098860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7bf2d-0ec9-41a4-ae08-5890d27ce01f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:34.100260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 666/1329] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:34.106987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52a5a-dc89-4a8d-adb3-23f6750180ec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:34.107478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52a5a-dc89-4a8d-adb3-23f6750180ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:34.107554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52a5a-dc89-4a8d-adb3-23f6750180ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:34.177161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9ed52a5a-dc89-4a8d-adb3-23f6750180ec None None] MFA Rules not processed for user `6d4c968bc8d646f3a5194fd6e06e5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:34.178990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9ed52a5a-dc89-4a8d-adb3-23f6750180ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:34.300883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 664/1330] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:34.340221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7bf2d-0ec9-41a4-ae08-5890d27ce01f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:34.341813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5eb7bf2d-0ec9-41a4-ae08-5890d27ce01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:34.380232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:34.465258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7bf2d-0ec9-41a4-ae08-5890d27ce01f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:34.543771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d2e6c-3420-4269-bdf3-a2a4eec48ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:34.544882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d2e6c-3420-4269-bdf3-a2a4eec48ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:34.545404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d2e6c-3420-4269-bdf3-a2a4eec48ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:34.545977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d2e6c-3420-4269-bdf3-a2a4eec48ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:34.547824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e70d2e6c-3420-4269-bdf3-a2a4eec48ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:34.645225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:34.684356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d2e6c-3420-4269-bdf3-a2a4eec48ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:34.686090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d2e6c-3420-4269-bdf3-a2a4eec48ad3 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:34.707796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 667/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:37.408570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a8106-4f00-432a-a8cc-4c61536306ce None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:37.409054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a8106-4f00-432a-a8cc-4c61536306ce None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:37.409280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a8106-4f00-432a-a8cc-4c61536306ce None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:37.411374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 665/1332] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:37.417998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed9edb-c057-4845-a590-a0f96b79e96c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:37.418464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed9edb-c057-4845-a590-a0f96b79e96c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:37.418558 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed9edb-c057-4845-a590-a0f96b79e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:37.487250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-80ed9edb-c057-4845-a590-a0f96b79e96c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:37.489720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-80ed9edb-c057-4845-a590-a0f96b79e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:37.599188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 668/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:37.635817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a8106-4f00-432a-a8cc-4c61536306ce None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:37.637399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-de1a8106-4f00-432a-a8cc-4c61536306ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:37.720327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:37.763349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a8106-4f00-432a-a8cc-4c61536306ce None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:37.867357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae9a8c-e6ee-4ea4-9f15-30c28dec46ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:37.868042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9a8c-e6ee-4ea4-9f15-30c28dec46ac service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:37.868332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9a8c-e6ee-4ea4-9f15-30c28dec46ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:37.868615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9a8c-e6ee-4ea4-9f15-30c28dec46ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:37.870376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-35ae9a8c-e6ee-4ea4-9f15-30c28dec46ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:38.011267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae9a8c-e6ee-4ea4-9f15-30c28dec46ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:38.012743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae9a8c-e6ee-4ea4-9f15-30c28dec46ac service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:38.024726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:38.036443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 666/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:40.449614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fca55b-0605-4c9a-8761-5d2d9961802a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:40.450184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fca55b-0605-4c9a-8761-5d2d9961802a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:40.450287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fca55b-0605-4c9a-8761-5d2d9961802a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:40.451805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 669/1335] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:40.457679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643dd2-6b63-4b2d-b5b8-9d6d599ffbf5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:40.458135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643dd2-6b63-4b2d-b5b8-9d6d599ffbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:40.458233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643dd2-6b63-4b2d-b5b8-9d6d599ffbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:40.659331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-19643dd2-6b63-4b2d-b5b8-9d6d599ffbf5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:40.660627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-19643dd2-6b63-4b2d-b5b8-9d6d599ffbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:40.764652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 667/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:51:40.806806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fca55b-0605-4c9a-8761-5d2d9961802a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:40.808352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d5fca55b-0605-4c9a-8761-5d2d9961802a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:40.850985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:40.922290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fca55b-0605-4c9a-8761-5d2d9961802a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:41.002370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362b598-0985-4956-862c-1f1cba07b183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:41.003028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362b598-0985-4956-862c-1f1cba07b183 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:41.003313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362b598-0985-4956-862c-1f1cba07b183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:41.003591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362b598-0985-4956-862c-1f1cba07b183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:41.005260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7362b598-0985-4956-862c-1f1cba07b183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:41.092657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:41.119737 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362b598-0985-4956-862c-1f1cba07b183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:41.121192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362b598-0985-4956-862c-1f1cba07b183 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:41.139986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 670/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:43.971606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1f0c-acc4-4838-bc05-45918b49e55e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:43.972140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1f0c-acc4-4838-bc05-45918b49e55e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:43.972140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1f0c-acc4-4838-bc05-45918b49e55e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:43.973505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 668/1338] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:43.979547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abde22-fd18-442b-b985-a6eede88dc19 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:43.980047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abde22-fd18-442b-b985-a6eede88dc19 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:43.980143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abde22-fd18-442b-b985-a6eede88dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:44.059679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-71abde22-fd18-442b-b985-a6eede88dc19 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:44.060913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-71abde22-fd18-442b-b985-a6eede88dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:44.170370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 671/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:44.209023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee1f0c-acc4-4838-bc05-45918b49e55e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:44.212021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-61ee1f0c-acc4-4838-bc05-45918b49e55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:44.296664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:51:44.313486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee1f0c-acc4-4838-bc05-45918b49e55e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:44.317400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09f816-921c-429a-9a13-0bf6729a4046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:44.318091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f816-921c-429a-9a13-0bf6729a4046 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:44.318376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f816-921c-429a-9a13-0bf6729a4046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:44.318654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f816-921c-429a-9a13-0bf6729a4046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:44.338800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09f816-921c-429a-9a13-0bf6729a4046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:44.340244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09f816-921c-429a-9a13-0bf6729a4046 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:44.350017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 669/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:51:48.767714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209807d4-e68a-4bc1-a0fa-d9707987681c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:48.768232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209807d4-e68a-4bc1-a0fa-d9707987681c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:48.768232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209807d4-e68a-4bc1-a0fa-d9707987681c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:48.769616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 672/1341] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:48.775192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25497a-dd30-438f-be1f-5c7027a9c7da None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:48.775721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25497a-dd30-438f-be1f-5c7027a9c7da None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:48.775880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25497a-dd30-438f-be1f-5c7027a9c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:48.809970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9c25497a-dd30-438f-be1f-5c7027a9c7da None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:48.811096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9c25497a-dd30-438f-be1f-5c7027a9c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:48.894507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 670/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:48.933876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209807d4-e68a-4bc1-a0fa-d9707987681c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:48.935734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-209807d4-e68a-4bc1-a0fa-d9707987681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:48.949003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209807d4-e68a-4bc1-a0fa-d9707987681c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:48.952734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d87d6-86f1-49d6-bbca-7a19ee2a1e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:48.953386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d87d6-86f1-49d6-bbca-7a19ee2a1e5d service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:48.953702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d87d6-86f1-49d6-bbca-7a19ee2a1e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:48.953982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d87d6-86f1-49d6-bbca-7a19ee2a1e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:48.964332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d87d6-86f1-49d6-bbca-7a19ee2a1e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:48.965815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d87d6-86f1-49d6-bbca-7a19ee2a1e5d service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:48.976432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 673/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:52.091737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b2fd-d1b1-435b-98e7-2e96480073ce None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:52.092343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b2fd-d1b1-435b-98e7-2e96480073ce None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:52.092718 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b2fd-d1b1-435b-98e7-2e96480073ce None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:52.094710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 671/1344] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:52.102000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c2c5c-58eb-40bf-89ec-3a33e495110d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:52.102000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c2c5c-58eb-40bf-89ec-3a33e495110d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:52.103068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c2c5c-58eb-40bf-89ec-3a33e495110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:52.125734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6c3c2c5c-58eb-40bf-89ec-3a33e495110d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:52.127141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c3c2c5c-58eb-40bf-89ec-3a33e495110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:52.138276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 674/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:52.177765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b2fd-d1b1-435b-98e7-2e96480073ce None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:52.189471 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b2fd-d1b1-435b-98e7-2e96480073ce None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:52.193219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dae9a-5993-4bfb-9a7d-0f97f1ed3b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:52.194703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dae9a-5993-4bfb-9a7d-0f97f1ed3b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:52.195078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dae9a-5993-4bfb-9a7d-0f97f1ed3b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:52.195432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dae9a-5993-4bfb-9a7d-0f97f1ed3b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:52.205138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dae9a-5993-4bfb-9a7d-0f97f1ed3b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:52.206713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dae9a-5993-4bfb-9a7d-0f97f1ed3b2c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:52.216913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 672/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:51:56.836650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ab1b9-7c35-4cb2-b6ac-f8ecf47d3684 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:56.837184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ab1b9-7c35-4cb2-b6ac-f8ecf47d3684 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:56.837184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ab1b9-7c35-4cb2-b6ac-f8ecf47d3684 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:56.838625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 675/1347] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:51:56.844352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566b79-91c6-4fae-9b4d-f23ae2fd0e74 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:56.844854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566b79-91c6-4fae-9b4d-f23ae2fd0e74 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:56.844948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566b79-91c6-4fae-9b4d-f23ae2fd0e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:56.863313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2a566b79-91c6-4fae-9b4d-f23ae2fd0e74 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:51:56.864526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2a566b79-91c6-4fae-9b4d-f23ae2fd0e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:51:56.873675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 673/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:51:56.912926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ab1b9-7c35-4cb2-b6ac-f8ecf47d3684 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:51:56.924838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ab1b9-7c35-4cb2-b6ac-f8ecf47d3684 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:51:56.930031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dff8af-4673-4bfd-a0a3-a4d84a34e07a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:51:56.930726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dff8af-4673-4bfd-a0a3-a4d84a34e07a service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:51:56.931021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dff8af-4673-4bfd-a0a3-a4d84a34e07a service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:51:56.931308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dff8af-4673-4bfd-a0a3-a4d84a34e07a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:51:56.941297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dff8af-4673-4bfd-a0a3-a4d84a34e07a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:51:56.942794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dff8af-4673-4bfd-a0a3-a4d84a34e07a service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:51:56.954971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 676/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:02.563518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48406a8-cbe5-49db-8ab6-3a30e8a602f8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:02.564348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48406a8-cbe5-49db-8ab6-3a30e8a602f8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:02.564928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48406a8-cbe5-49db-8ab6-3a30e8a602f8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:02.571028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 674/1350] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 12:52:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:02.581021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8611-459e-4cf9-8549-e9b25fb83d78 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:02.582089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8611-459e-4cf9-8549-e9b25fb83d78 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:02.582553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8611-459e-4cf9-8549-e9b25fb83d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:02.619381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:52:02.688514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-124d8611-459e-4cf9-8549-e9b25fb83d78 None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:02.691664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-124d8611-459e-4cf9-8549-e9b25fb83d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:02.790837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 677/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:06.859905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=57 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:52:07.447461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84556b-53a0-48c8-abee-881858f3bd1c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:07.447999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84556b-53a0-48c8-abee-881858f3bd1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:07.448278 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84556b-53a0-48c8-abee-881858f3bd1c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:07.449859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 675/1352] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 12:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:07.454848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579bcea-7e92-47ca-a429-b2d579b3cc7c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:07.455357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579bcea-7e92-47ca-a429-b2d579b3cc7c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:07.455436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579bcea-7e92-47ca-a429-b2d579b3cc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:07.477745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f579bcea-7e92-47ca-a429-b2d579b3cc7c None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:07.479295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f579bcea-7e92-47ca-a429-b2d579b3cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:07.488398 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 678/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:09.183439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2996-93a8-4562-bb2f-b3510a38e84e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:09.184075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2996-93a8-4562-bb2f-b3510a38e84e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:09.184075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2996-93a8-4562-bb2f-b3510a38e84e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:09.185675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 676/1354] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 12:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:09.190577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c906e84-a3a8-4f28-9291-df878732532a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:09.191034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c906e84-a3a8-4f28-9291-df878732532a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:09.191154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c906e84-a3a8-4f28-9291-df878732532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:09.340613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5c906e84-a3a8-4f28-9291-df878732532a None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:09.341874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5c906e84-a3a8-4f28-9291-df878732532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:09.350757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 679/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:52:13.063225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded259-6c39-40e1-94d6-22c91b929624 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:13.063767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded259-6c39-40e1-94d6-22c91b929624 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:13.063767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded259-6c39-40e1-94d6-22c91b929624 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:13.065139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 677/1356] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:13.071227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b465b-6859-421a-93e4-2f2e0fdebc0f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:13.071668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b465b-6859-421a-93e4-2f2e0fdebc0f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:13.071833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b465b-6859-421a-93e4-2f2e0fdebc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:13.092960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-581b465b-6859-421a-93e4-2f2e0fdebc0f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:13.094420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-581b465b-6859-421a-93e4-2f2e0fdebc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:13.103680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 680/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:13.159096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c087-1029-4fa1-a9cd-b05d820a4eef None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:13.159653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c087-1029-4fa1-a9cd-b05d820a4eef None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:13.160154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c087-1029-4fa1-a9cd-b05d820a4eef None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:13.162061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 678/1358] 10.222.0.46 () {54 vars in 961 bytes} [Wed Jun 8 12:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:13.170636 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f961-cd7b-4eab-bdb8-629bd8c1d7f0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:13.170940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f961-cd7b-4eab-bdb8-629bd8c1d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:13.171395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f961-cd7b-4eab-bdb8-629bd8c1d7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:13.237085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ec54f961-cd7b-4eab-bdb8-629bd8c1d7f0 None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:13.238577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ec54f961-cd7b-4eab-bdb8-629bd8c1d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:13.319691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:52:13.351364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 681/1359] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Jun 8 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:13.359292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26c087-1029-4fa1-a9cd-b05d820a4eef None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:13.375328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26c087-1029-4fa1-a9cd-b05d820a4eef None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:13.381898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3c1ff-d1b2-4f54-b7f8-cdb7f8eed14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:13.382681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c1ff-d1b2-4f54-b7f8-cdb7f8eed14e service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:13.382978 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c1ff-d1b2-4f54-b7f8-cdb7f8eed14e service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:13.383267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c1ff-d1b2-4f54-b7f8-cdb7f8eed14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:13.396231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3c1ff-d1b2-4f54-b7f8-cdb7f8eed14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:13.398469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3c1ff-d1b2-4f54-b7f8-cdb7f8eed14e service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:13.412649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 679/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:15.972572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89117d-96b9-4ded-8b03-a170ff0fad62 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:15.973131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89117d-96b9-4ded-8b03-a170ff0fad62 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:15.973131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89117d-96b9-4ded-8b03-a170ff0fad62 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:15.975460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 682/1361] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:52:15.981332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939b64-f156-46ac-b17e-93ce3f75e0a5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:15.981887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939b64-f156-46ac-b17e-93ce3f75e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:15.981981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939b64-f156-46ac-b17e-93ce3f75e0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:16.002890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5a939b64-f156-46ac-b17e-93ce3f75e0a5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:16.004518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a939b64-f156-46ac-b17e-93ce3f75e0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:16.014557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 680/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:16.061169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89117d-96b9-4ded-8b03-a170ff0fad62 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:16.076460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89117d-96b9-4ded-8b03-a170ff0fad62 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:16.082102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a86967-6bd5-4a16-9dbc-3926b440dfce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:16.082770 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86967-6bd5-4a16-9dbc-3926b440dfce service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:16.083061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86967-6bd5-4a16-9dbc-3926b440dfce service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:16.083350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86967-6bd5-4a16-9dbc-3926b440dfce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:16.098300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a86967-6bd5-4a16-9dbc-3926b440dfce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:16.101026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a86967-6bd5-4a16-9dbc-3926b440dfce service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:16.115394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 683/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:19.002335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87ad0-18ec-4b73-8e8b-7a9a8cb8548b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:19.002844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87ad0-18ec-4b73-8e8b-7a9a8cb8548b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:19.002844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87ad0-18ec-4b73-8e8b-7a9a8cb8548b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:19.004193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 681/1364] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:19.009934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d0d33-9927-4920-94d0-d7a80d8b65a1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:19.010402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d0d33-9927-4920-94d0-d7a80d8b65a1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:19.010481 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d0d33-9927-4920-94d0-d7a80d8b65a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:19.030320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ca8d0d33-9927-4920-94d0-d7a80d8b65a1 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:19.031843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca8d0d33-9927-4920-94d0-d7a80d8b65a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:19.040742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 684/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:19.085914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4af3-e307-4fb6-9355-ea969ba0f637 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:19.086206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4af3-e307-4fb6-9355-ea969ba0f637 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:19.086489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4af3-e307-4fb6-9355-ea969ba0f637 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:19.087872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 682/1366] 10.222.0.46 () {54 vars in 961 bytes} [Wed Jun 8 12:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:19.093894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c624efb-6563-4e40-b4ed-06457d1acaac None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:19.094433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c624efb-6563-4e40-b4ed-06457d1acaac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:19.094753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c624efb-6563-4e40-b4ed-06457d1acaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:19.115370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5c624efb-6563-4e40-b4ed-06457d1acaac None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:19.116980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5c624efb-6563-4e40-b4ed-06457d1acaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:19.126420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 685/1367] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Jun 8 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:19.135632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b4af3-e307-4fb6-9355-ea969ba0f637 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:19.150494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b4af3-e307-4fb6-9355-ea969ba0f637 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:19.156279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d78b-6628-48d0-bc4f-7d6a9db6ff04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:19.157003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d78b-6628-48d0-bc4f-7d6a9db6ff04 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:19.157292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d78b-6628-48d0-bc4f-7d6a9db6ff04 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:19.157591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d78b-6628-48d0-bc4f-7d6a9db6ff04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:19.167861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118d78b-6628-48d0-bc4f-7d6a9db6ff04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:19.169461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118d78b-6628-48d0-bc4f-7d6a9db6ff04 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:19.180472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 683/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:21.673413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d05c-ccc1-4efa-8e3a-b76f6f80fef6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:21.674332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d05c-ccc1-4efa-8e3a-b76f6f80fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:21.674830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d05c-ccc1-4efa-8e3a-b76f6f80fef6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:21.676524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 686/1369] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:21.683593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae729-fe54-49e2-a38a-ddd1ee2f78c2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:21.684126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae729-fe54-49e2-a38a-ddd1ee2f78c2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:21.684208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae729-fe54-49e2-a38a-ddd1ee2f78c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:21.704224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b2cae729-fe54-49e2-a38a-ddd1ee2f78c2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:21.705455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b2cae729-fe54-49e2-a38a-ddd1ee2f78c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:21.717809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 684/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:21.763848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2d05c-ccc1-4efa-8e3a-b76f6f80fef6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:21.766192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f06b98-854d-48b4-bfff-397048662838 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:21.766428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f06b98-854d-48b4-bfff-397048662838 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:21.766740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f06b98-854d-48b4-bfff-397048662838 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:21.768377 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 685/1371] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:21.774401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d51c0-9368-459d-ae80-a01cb1ad8a6c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:21.774674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d51c0-9368-459d-ae80-a01cb1ad8a6c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:21.775182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d51c0-9368-459d-ae80-a01cb1ad8a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:21.780394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2d05c-ccc1-4efa-8e3a-b76f6f80fef6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:21.786230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9607be-664f-417c-9f95-492a0ab13a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:21.787503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9607be-664f-417c-9f95-492a0ab13a25 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:21.787917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9607be-664f-417c-9f95-492a0ab13a25 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:21.788478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9607be-664f-417c-9f95-492a0ab13a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:21.797634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9607be-664f-417c-9f95-492a0ab13a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:21.799257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9607be-664f-417c-9f95-492a0ab13a25 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:21.803178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b99d51c0-9368-459d-ae80-a01cb1ad8a6c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:21.804558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b99d51c0-9368-459d-ae80-a01cb1ad8a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:21.813162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 686/1372] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:21.815281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 687/1373] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:22.142424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25f6a-4024-4992-ba3b-b7cc082ea69c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:22.142424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25f6a-4024-4992-ba3b-b7cc082ea69c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:22.142424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25f6a-4024-4992-ba3b-b7cc082ea69c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:22.145012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 687/1374] 10.222.0.46 () {54 vars in 963 bytes} [Wed Jun 8 12:52:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:22.148820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265690-1504-483d-88a6-71d9341563e6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:22.149116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265690-1504-483d-88a6-71d9341563e6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:22.149429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265690-1504-483d-88a6-71d9341563e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:22.214216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a7265690-1504-483d-88a6-71d9341563e6 None None] MFA Rules not processed for user `d83990f7249442a582403e654a2278f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:22.215832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a7265690-1504-483d-88a6-71d9341563e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:22.290081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 688/1375] 10.222.0.46 () {58 vars in 1060 bytes} [Wed Jun 8 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:22.297884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad25f6a-4024-4992-ba3b-b7cc082ea69c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:22.313357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad25f6a-4024-4992-ba3b-b7cc082ea69c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:22.318913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714d9f2-38e9-4da0-a615-9bcfae6702d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:22.318913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d9f2-38e9-4da0-a615-9bcfae6702d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:22.318913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d9f2-38e9-4da0-a615-9bcfae6702d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:22.318913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d9f2-38e9-4da0-a615-9bcfae6702d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:22.329741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714d9f2-38e9-4da0-a615-9bcfae6702d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:22.331507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714d9f2-38e9-4da0-a615-9bcfae6702d7 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:22.342744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 688/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:24.246415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73819145-b2be-4ae5-98bf-1584bcabc898 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:24.246963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73819145-b2be-4ae5-98bf-1584bcabc898 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:24.246963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73819145-b2be-4ae5-98bf-1584bcabc898 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:24.248401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 689/1377] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:24.254422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300ce0-f5a9-4c76-94fc-facedd214dab None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:24.254972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300ce0-f5a9-4c76-94fc-facedd214dab None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:24.255108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300ce0-f5a9-4c76-94fc-facedd214dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:24.275028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c6300ce0-f5a9-4c76-94fc-facedd214dab None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:24.276293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c6300ce0-f5a9-4c76-94fc-facedd214dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:24.284691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 689/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:24.331322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73819145-b2be-4ae5-98bf-1584bcabc898 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:24.348482 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73819145-b2be-4ae5-98bf-1584bcabc898 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:24.356786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dd68a-cc0a-438c-a062-2e9d8110f0c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:24.357792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd68a-cc0a-438c-a062-2e9d8110f0c6 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:24.358085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd68a-cc0a-438c-a062-2e9d8110f0c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:24.358373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd68a-cc0a-438c-a062-2e9d8110f0c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:24.368928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dd68a-cc0a-438c-a062-2e9d8110f0c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:24.370625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dd68a-cc0a-438c-a062-2e9d8110f0c6 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:24.381860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 690/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:26.770288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a8f6-3aeb-4d6f-8b04-9d03ecf9c8d7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:26.770830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a8f6-3aeb-4d6f-8b04-9d03ecf9c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:26.770830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a8f6-3aeb-4d6f-8b04-9d03ecf9c8d7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:26.772858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 690/1380] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:26.778480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab18b-54f2-41e3-9474-c1b29b6c3837 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:26.779009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab18b-54f2-41e3-9474-c1b29b6c3837 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:26.779107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab18b-54f2-41e3-9474-c1b29b6c3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:26.798898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-131ab18b-54f2-41e3-9474-c1b29b6c3837 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:26.798898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-131ab18b-54f2-41e3-9474-c1b29b6c3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:26.806750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 691/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:26.853598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a8f6-3aeb-4d6f-8b04-9d03ecf9c8d7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:26.872961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a8f6-3aeb-4d6f-8b04-9d03ecf9c8d7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:26.879506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b1614-00a8-4b05-a461-8791e13ac8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:26.880164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b1614-00a8-4b05-a461-8791e13ac8a9 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:26.880452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b1614-00a8-4b05-a461-8791e13ac8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:26.881222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b1614-00a8-4b05-a461-8791e13ac8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:26.892875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b1614-00a8-4b05-a461-8791e13ac8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:26.894537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b1614-00a8-4b05-a461-8791e13ac8a9 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:26.907176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 691/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:29.300706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3b51-902b-49e2-88a4-14ce9aef4d2c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:29.301210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3b51-902b-49e2-88a4-14ce9aef4d2c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:29.301210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3b51-902b-49e2-88a4-14ce9aef4d2c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:29.303234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 692/1383] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:29.309010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd373-616f-49d9-a755-67292b61bbb4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:29.309010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd373-616f-49d9-a755-67292b61bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:29.309945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd373-616f-49d9-a755-67292b61bbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:29.328602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c61fd373-616f-49d9-a755-67292b61bbb4 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:29.329829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c61fd373-616f-49d9-a755-67292b61bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:29.358165 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 692/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:29.392195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c3b51-902b-49e2-88a4-14ce9aef4d2c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:29.410228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c3b51-902b-49e2-88a4-14ce9aef4d2c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:29.416853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4d189-f65f-4341-939a-2fb4c9c87e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:29.417504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4d189-f65f-4341-939a-2fb4c9c87e2b service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:29.417821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4d189-f65f-4341-939a-2fb4c9c87e2b service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:29.418211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4d189-f65f-4341-939a-2fb4c9c87e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:29.427303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4d189-f65f-4341-939a-2fb4c9c87e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:29.429260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4d189-f65f-4341-939a-2fb4c9c87e2b service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:29.441714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 693/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:31.840110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54289ee-1740-4048-9815-52374c2cf089 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:31.840635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54289ee-1740-4048-9815-52374c2cf089 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:31.840717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54289ee-1740-4048-9815-52374c2cf089 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:31.842219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 693/1386] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:31.850398 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6838-b42c-478f-a162-b29ae3e16088 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:31.851090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6838-b42c-478f-a162-b29ae3e16088 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:31.851090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6838-b42c-478f-a162-b29ae3e16088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:31.876402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dcaa6838-b42c-478f-a162-b29ae3e16088 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:31.877717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dcaa6838-b42c-478f-a162-b29ae3e16088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:31.886002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 694/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:31.951305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54289ee-1740-4048-9815-52374c2cf089 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:31.970659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54289ee-1740-4048-9815-52374c2cf089 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:31.978147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9bbaa-e179-4bee-96d2-1414b4ee2dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:31.979171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9bbaa-e179-4bee-96d2-1414b4ee2dab service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:31.979677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9bbaa-e179-4bee-96d2-1414b4ee2dab service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:31.980162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9bbaa-e179-4bee-96d2-1414b4ee2dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:31.993985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9bbaa-e179-4bee-96d2-1414b4ee2dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:31.996678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9bbaa-e179-4bee-96d2-1414b4ee2dab service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:32.013323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 694/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:34.372725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dd679-a557-406f-9c8b-0a23a7fac125 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:34.373279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dd679-a557-406f-9c8b-0a23a7fac125 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:34.373707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dd679-a557-406f-9c8b-0a23a7fac125 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:34.375622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 695/1389] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:34.384761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058f3b4-0b5a-405c-8cb8-d1e96585c0c0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:34.385538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058f3b4-0b5a-405c-8cb8-d1e96585c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:34.386203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058f3b4-0b5a-405c-8cb8-d1e96585c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:34.424680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4058f3b4-0b5a-405c-8cb8-d1e96585c0c0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:34.426313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4058f3b4-0b5a-405c-8cb8-d1e96585c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:34.441640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 695/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:34.506616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785dd679-a557-406f-9c8b-0a23a7fac125 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:34.531516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785dd679-a557-406f-9c8b-0a23a7fac125 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:34.543816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11951e-e0de-48ff-8831-c330f329c84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:34.544760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11951e-e0de-48ff-8831-c330f329c84e service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:34.545280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11951e-e0de-48ff-8831-c330f329c84e service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:34.545751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11951e-e0de-48ff-8831-c330f329c84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:34.561400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11951e-e0de-48ff-8831-c330f329c84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:34.564348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11951e-e0de-48ff-8831-c330f329c84e service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:34.580008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 696/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:37.308211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ea55-1a9a-4f51-acaa-41d1a933e0d2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:37.308823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ea55-1a9a-4f51-acaa-41d1a933e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:37.308823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ea55-1a9a-4f51-acaa-41d1a933e0d2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:37.310177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 696/1392] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:37.315532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622473c-887b-4143-b6a5-bbe4d6eff2e1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:37.315992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622473c-887b-4143-b6a5-bbe4d6eff2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:37.316095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622473c-887b-4143-b6a5-bbe4d6eff2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:37.334980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d622473c-887b-4143-b6a5-bbe4d6eff2e1 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:37.336208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d622473c-887b-4143-b6a5-bbe4d6eff2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:37.344339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 697/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:37.393225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614ea55-1a9a-4f51-acaa-41d1a933e0d2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:37.399544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=49 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:52:37.409464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614ea55-1a9a-4f51-acaa-41d1a933e0d2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:37.414534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86ce55-841c-4c20-b497-0c738ed73103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:37.415203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ce55-841c-4c20-b497-0c738ed73103 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:37.415490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ce55-841c-4c20-b497-0c738ed73103 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:37.415773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ce55-841c-4c20-b497-0c738ed73103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:37.425381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86ce55-841c-4c20-b497-0c738ed73103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:37.427033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86ce55-841c-4c20-b497-0c738ed73103 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:37.442259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 697/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:38.687829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee9db5-dec1-4c40-b0f6-e76a1bfab214 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:38.688402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee9db5-dec1-4c40-b0f6-e76a1bfab214 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:38.688402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee9db5-dec1-4c40-b0f6-e76a1bfab214 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:38.690486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 698/1395] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:38.700280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359212e-af54-48bb-a4a2-443321441d4b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:38.700798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359212e-af54-48bb-a4a2-443321441d4b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:38.701261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359212e-af54-48bb-a4a2-443321441d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:38.724924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7359212e-af54-48bb-a4a2-443321441d4b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:38.726186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7359212e-af54-48bb-a4a2-443321441d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:38.744248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 698/1396] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:38.809233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f2d8-1451-4e57-86af-f17234adb7e1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:38.809526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f2d8-1451-4e57-86af-f17234adb7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:38.809852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f2d8-1451-4e57-86af-f17234adb7e1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:38.811255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 699/1397] 10.222.0.46 () {54 vars in 962 bytes} [Wed Jun 8 12:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:38.817488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdc0a2-3af8-4674-81f1-9461b1675c54 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:38.817814 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdc0a2-3af8-4674-81f1-9461b1675c54 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:38.818121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdc0a2-3af8-4674-81f1-9461b1675c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:38.870572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-83cdc0a2-3af8-4674-81f1-9461b1675c54 None None] MFA Rules not processed for user `998c7b05ebe64f5c95bcb86a49e673ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:38.871798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-83cdc0a2-3af8-4674-81f1-9461b1675c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:38.935052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 699/1398] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Jun 8 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:38.942819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480f2d8-1451-4e57-86af-f17234adb7e1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:38.953750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480f2d8-1451-4e57-86af-f17234adb7e1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:38.957362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f3c46-5f8a-4ccf-870e-b336732bc0d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:38.958056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3c46-5f8a-4ccf-870e-b336732bc0d3 service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:38.958619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3c46-5f8a-4ccf-870e-b336732bc0d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:38.959038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3c46-5f8a-4ccf-870e-b336732bc0d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:38.968786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f3c46-5f8a-4ccf-870e-b336732bc0d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:38.970276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f3c46-5f8a-4ccf-870e-b336732bc0d3 service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:38.981065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 700/1399] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:39.531675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c929-a6a8-4851-90a0-a98ade0e365b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:39.531967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c929-a6a8-4851-90a0-a98ade0e365b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:39.532249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c929-a6a8-4851-90a0-a98ade0e365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:39.591672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4a93c929-a6a8-4851-90a0-a98ade0e365b None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:39.592994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4a93c929-a6a8-4851-90a0-a98ade0e365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:39.661955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 700/1400] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:39.704032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177f64a-3972-4192-ba31-dfc5ee91cca0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:39.704498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177f64a-3972-4192-ba31-dfc5ee91cca0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:39.704606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177f64a-3972-4192-ba31-dfc5ee91cca0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:39.706117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 701/1401] 10.222.0.46 () {54 vars in 942 bytes} [Wed Jun 8 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:39.713374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ab87-6b54-433a-b1af-b7193335d18e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:39.713875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ab87-6b54-433a-b1af-b7193335d18e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:39.714018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ab87-6b54-433a-b1af-b7193335d18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:39.762472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:52:39.766164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9291ab87-6b54-433a-b1af-b7193335d18e None None] MFA Rules not processed for user `1706af7489064b9f9087b740249630b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:39.767884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9291ab87-6b54-433a-b1af-b7193335d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:39.786370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1163-12fb-4389-bef5-ddb3f45f0601 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:39.786775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1163-12fb-4389-bef5-ddb3f45f0601 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:39.787064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1163-12fb-4389-bef5-ddb3f45f0601 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:39.788465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 702/1402] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:39.794028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761a97-52bc-4e7e-97a5-9540f0516947 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:39.794319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761a97-52bc-4e7e-97a5-9540f0516947 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:39.794631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761a97-52bc-4e7e-97a5-9540f0516947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:39.812613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-94761a97-52bc-4e7e-97a5-9540f0516947 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:39.814172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94761a97-52bc-4e7e-97a5-9540f0516947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:39.823872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 703/1403] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:52:39.850421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 701/1404] 10.222.0.46 () {58 vars in 1039 bytes} [Wed Jun 8 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:52:39.860389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761a97-52bc-4e7e-97a5-9540f0516947 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:39.873399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ab87-6b54-433a-b1af-b7193335d18e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:39.874839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761a97-52bc-4e7e-97a5-9540f0516947 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:39.880001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd7ff-abf1-45d2-bf0b-e42747c2cb55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:39.881190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd7ff-abf1-45d2-bf0b-e42747c2cb55 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:39.881701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd7ff-abf1-45d2-bf0b-e42747c2cb55 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:39.881987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd7ff-abf1-45d2-bf0b-e42747c2cb55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:39.886818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ab87-6b54-433a-b1af-b7193335d18e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:39.887356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:52:39.891915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dd7ff-abf1-45d2-bf0b-e42747c2cb55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:39.892747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ac26-665a-446f-89de-7c5bf44fc1bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:39.893411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ac26-665a-446f-89de-7c5bf44fc1bc service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:39.893518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dd7ff-abf1-45d2-bf0b-e42747c2cb55 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:39.893726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ac26-665a-446f-89de-7c5bf44fc1bc service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:39.894012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ac26-665a-446f-89de-7c5bf44fc1bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:39.902839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 704/1405] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 12:52:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:52:39.904187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563ac26-665a-446f-89de-7c5bf44fc1bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:39.906733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563ac26-665a-446f-89de-7c5bf44fc1bc service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:39.917458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 702/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:52:42.373155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e4643-bd3f-45e1-9e2e-699f07a25e3e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:42.373749 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e4643-bd3f-45e1-9e2e-699f07a25e3e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:42.373881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e4643-bd3f-45e1-9e2e-699f07a25e3e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:42.375492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 705/1407] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:52:42.381578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0492e-18aa-481b-9107-56698cbb6629 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:42.382012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0492e-18aa-481b-9107-56698cbb6629 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:42.382297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0492e-18aa-481b-9107-56698cbb6629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:42.403654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2cc0492e-18aa-481b-9107-56698cbb6629 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:52:42.405133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2cc0492e-18aa-481b-9107-56698cbb6629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:52:42.421900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 703/1408] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:52:42.462927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e4643-bd3f-45e1-9e2e-699f07a25e3e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:52:42.477957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e4643-bd3f-45e1-9e2e-699f07a25e3e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:52:42.483357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366825e-84cf-46fa-acea-e9f789f20836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:52:42.483998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366825e-84cf-46fa-acea-e9f789f20836 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:52:42.484280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366825e-84cf-46fa-acea-e9f789f20836 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:52:42.484564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366825e-84cf-46fa-acea-e9f789f20836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:52:42.493704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366825e-84cf-46fa-acea-e9f789f20836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:52:42.495568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366825e-84cf-46fa-acea-e9f789f20836 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:52:42.506832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 706/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:52:52.396715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=39 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:52:52.842536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=9 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:53:03.573970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9456c-4a1f-4180-be0a-7f2b24dfe31c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:03.574613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9456c-4a1f-4180-be0a-7f2b24dfe31c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:03.574613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9456c-4a1f-4180-be0a-7f2b24dfe31c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:03.575961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 704/1410] 10.222.0.46 () {54 vars in 918 bytes} [Wed Jun 8 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:03.581946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b056-f120-4b69-b9f9-5c63f2b21739 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:03.582379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b056-f120-4b69-b9f9-5c63f2b21739 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:03.582497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b056-f120-4b69-b9f9-5c63f2b21739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:03.601731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a801b056-f120-4b69-b9f9-5c63f2b21739 None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:03.602915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a801b056-f120-4b69-b9f9-5c63f2b21739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:03.611317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 707/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Jun 8 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:03.626024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910e9b-774f-4028-8c62-d0ecda913de9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:03.626308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910e9b-774f-4028-8c62-d0ecda913de9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:03.626582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910e9b-774f-4028-8c62-d0ecda913de9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:03.627927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 705/1412] 10.222.0.46 () {54 vars in 918 bytes} [Wed Jun 8 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:03.632950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748e8c6-34dd-406a-bb88-8aaae3e9a3d0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:03.633238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748e8c6-34dd-406a-bb88-8aaae3e9a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:03.633515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748e8c6-34dd-406a-bb88-8aaae3e9a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:03.651467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9748e8c6-34dd-406a-bb88-8aaae3e9a3d0 None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:03.652646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9748e8c6-34dd-406a-bb88-8aaae3e9a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:03.662364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 708/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Jun 8 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:06.428097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36966d-fbe5-4447-be47-08822c31c3ff None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:06.428621 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36966d-fbe5-4447-be47-08822c31c3ff None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:06.428720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36966d-fbe5-4447-be47-08822c31c3ff None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:06.430054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:06.435397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff16328-b894-4dfc-b132-43c1c78d0821 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:06.435795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff16328-b894-4dfc-b132-43c1c78d0821 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:06.435968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff16328-b894-4dfc-b132-43c1c78d0821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:06.454315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5ff16328-b894-4dfc-b132-43c1c78d0821 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:06.455521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5ff16328-b894-4dfc-b132-43c1c78d0821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:06.464154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:06.507735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36966d-fbe5-4447-be47-08822c31c3ff None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:06.522443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36966d-fbe5-4447-be47-08822c31c3ff None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:06.527826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665481c-cc00-4580-8d3d-a66c460f56e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:06.528467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665481c-cc00-4580-8d3d-a66c460f56e9 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:06.528751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665481c-cc00-4580-8d3d-a66c460f56e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:06.529032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665481c-cc00-4580-8d3d-a66c460f56e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:06.538234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665481c-cc00-4580-8d3d-a66c460f56e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:06.540420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665481c-cc00-4580-8d3d-a66c460f56e9 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:06.551322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 707/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:07.571277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7ca4-9875-4c26-b80e-2518e0968be2 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:07.571842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7ca4-9875-4c26-b80e-2518e0968be2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:07.571842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7ca4-9875-4c26-b80e-2518e0968be2 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:07.573227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:07.578139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ac20-e4db-4151-b915-34bad253d035 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:07.578564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ac20-e4db-4151-b915-34bad253d035 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:07.578702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ac20-e4db-4151-b915-34bad253d035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:07.596666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9844ac20-e4db-4151-b915-34bad253d035 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:07.597917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9844ac20-e4db-4151-b915-34bad253d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:07.605810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:07.768612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7ca4-9875-4c26-b80e-2518e0968be2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:07.783367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7ca4-9875-4c26-b80e-2518e0968be2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:07.789332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc95a-3d48-43fd-a7a6-c14cfc4561c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:07.790013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc95a-3d48-43fd-a7a6-c14cfc4561c7 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:07.790305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc95a-3d48-43fd-a7a6-c14cfc4561c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:07.790589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc95a-3d48-43fd-a7a6-c14cfc4561c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:07.798851 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc95a-3d48-43fd-a7a6-c14cfc4561c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:07.800447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc95a-3d48-43fd-a7a6-c14cfc4561c7 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:07.810796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 711/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:08.774681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3ab2-421e-48d7-8a33-a692929bacfe None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:08.775198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3ab2-421e-48d7-8a33-a692929bacfe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:08.775198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3ab2-421e-48d7-8a33-a692929bacfe None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:08.776540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:08.781661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8131-2a51-473b-9ec7-acbc6207558a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:08.782068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8131-2a51-473b-9ec7-acbc6207558a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:08.782219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8131-2a51-473b-9ec7-acbc6207558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:08.800569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bd8b8131-2a51-473b-9ec7-acbc6207558a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:08.802527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bd8b8131-2a51-473b-9ec7-acbc6207558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:08.810371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:08.966234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3ab2-421e-48d7-8a33-a692929bacfe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:08.981316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3ab2-421e-48d7-8a33-a692929bacfe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:08.986804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb313bc-e093-49c7-9997-91b7a46b40f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:08.987443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb313bc-e093-49c7-9997-91b7a46b40f1 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:08.987731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb313bc-e093-49c7-9997-91b7a46b40f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:08.988014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb313bc-e093-49c7-9997-91b7a46b40f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:08.996476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb313bc-e093-49c7-9997-91b7a46b40f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:08.998106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb313bc-e093-49c7-9997-91b7a46b40f1 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:09.007544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 710/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:53:09.915474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bff46-316e-412b-88b2-79d722c30536 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:09.916057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bff46-316e-412b-88b2-79d722c30536 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:09.916057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bff46-316e-412b-88b2-79d722c30536 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:09.917592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:09.923024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961d3b-1d42-4e21-ae55-8b0cbcd516f4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:09.923813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961d3b-1d42-4e21-ae55-8b0cbcd516f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:09.923813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961d3b-1d42-4e21-ae55-8b0cbcd516f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:09.941812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2e961d3b-1d42-4e21-ae55-8b0cbcd516f4 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:09.943589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2e961d3b-1d42-4e21-ae55-8b0cbcd516f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:09.951363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:10.102989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bff46-316e-412b-88b2-79d722c30536 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:10.117611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bff46-316e-412b-88b2-79d722c30536 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:10.123038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab03fc2-9636-4743-8a6c-1ce52918b176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:10.123675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab03fc2-9636-4743-8a6c-1ce52918b176 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:10.123965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab03fc2-9636-4743-8a6c-1ce52918b176 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:10.124237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab03fc2-9636-4743-8a6c-1ce52918b176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:10.133089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab03fc2-9636-4743-8a6c-1ce52918b176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:10.134699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab03fc2-9636-4743-8a6c-1ce52918b176 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:10.143962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 714/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:11.065900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969a49-649f-4aa5-bfaf-9cd544e99b78 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:11.066417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969a49-649f-4aa5-bfaf-9cd544e99b78 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:11.066517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969a49-649f-4aa5-bfaf-9cd544e99b78 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:11.067921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:11.073190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196529-f0e1-4a4c-8f17-86a18ace8121 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:11.073655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196529-f0e1-4a4c-8f17-86a18ace8121 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:11.073796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46196529-f0e1-4a4c-8f17-86a18ace8121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:11.093341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-46196529-f0e1-4a4c-8f17-86a18ace8121 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:11.094586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-46196529-f0e1-4a4c-8f17-86a18ace8121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:11.105899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:11.255965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03969a49-649f-4aa5-bfaf-9cd544e99b78 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:11.270946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03969a49-649f-4aa5-bfaf-9cd544e99b78 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:11.276895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4372-f072-454b-abe1-41f5dda3fd0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:11.277537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4372-f072-454b-abe1-41f5dda3fd0b service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:11.277851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4372-f072-454b-abe1-41f5dda3fd0b service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:11.278134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4372-f072-454b-abe1-41f5dda3fd0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:11.287838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4372-f072-454b-abe1-41f5dda3fd0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:11.289413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4372-f072-454b-abe1-41f5dda3fd0b service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:11.300178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 713/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:12.158029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ea68-f92d-4195-9c12-eb7327478258 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:12.158560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ea68-f92d-4195-9c12-eb7327478258 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:12.158679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ea68-f92d-4195-9c12-eb7327478258 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:12.159973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:12.165520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbee28-007b-4c10-b8e7-63ec57bda763 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:12.165981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbee28-007b-4c10-b8e7-63ec57bda763 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:12.166085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbee28-007b-4c10-b8e7-63ec57bda763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:12.184522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-25dbee28-007b-4c10-b8e7-63ec57bda763 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:12.185740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-25dbee28-007b-4c10-b8e7-63ec57bda763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:12.194476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:12.344336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ea68-f92d-4195-9c12-eb7327478258 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:12.366147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ea68-f92d-4195-9c12-eb7327478258 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:12.372592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1793736-93e5-4a6c-8837-409162b14a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:12.373241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1793736-93e5-4a6c-8837-409162b14a27 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:12.373533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1793736-93e5-4a6c-8837-409162b14a27 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:12.373851 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1793736-93e5-4a6c-8837-409162b14a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:12.383601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1793736-93e5-4a6c-8837-409162b14a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:12.385465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1793736-93e5-4a6c-8837-409162b14a27 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:12.396266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 717/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:13.254272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb0ec-0804-4851-9cbe-376e70c594d1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:13.255425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb0ec-0804-4851-9cbe-376e70c594d1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:13.255425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb0ec-0804-4851-9cbe-376e70c594d1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:13.256756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:13.261848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22def-60e4-48d8-be3a-8cb8ec91c5f0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:13.262309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22def-60e4-48d8-be3a-8cb8ec91c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:13.262456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22def-60e4-48d8-be3a-8cb8ec91c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:13.281414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-11a22def-60e4-48d8-be3a-8cb8ec91c5f0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:13.282653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-11a22def-60e4-48d8-be3a-8cb8ec91c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:13.290790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:53:13.438036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddb0ec-0804-4851-9cbe-376e70c594d1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:13.453261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddb0ec-0804-4851-9cbe-376e70c594d1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:13.459251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e46be-4f79-470f-a0c1-4c74186de0b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:13.459892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e46be-4f79-470f-a0c1-4c74186de0b5 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:13.460174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e46be-4f79-470f-a0c1-4c74186de0b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:13.460460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e46be-4f79-470f-a0c1-4c74186de0b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:13.468618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e46be-4f79-470f-a0c1-4c74186de0b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:13.470247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e46be-4f79-470f-a0c1-4c74186de0b5 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:13.479891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 716/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:14.338490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afbb9-d11b-467e-9eb7-9a85bd1c47fa None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:14.339031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afbb9-d11b-467e-9eb7-9a85bd1c47fa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:14.339031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afbb9-d11b-467e-9eb7-9a85bd1c47fa None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:14.340417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:14.345575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48d5a-d3f5-4945-a186-3f7546b52899 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:14.346035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48d5a-d3f5-4945-a186-3f7546b52899 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:14.346130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48d5a-d3f5-4945-a186-3f7546b52899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:14.364615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-81b48d5a-d3f5-4945-a186-3f7546b52899 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:14.365840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-81b48d5a-d3f5-4945-a186-3f7546b52899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:14.373749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:14.522870 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1afbb9-d11b-467e-9eb7-9a85bd1c47fa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:14.537589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1afbb9-d11b-467e-9eb7-9a85bd1c47fa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:14.543820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb671-3b58-4b14-bf00-7784dfaafcef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:14.544466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb671-3b58-4b14-bf00-7784dfaafcef service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:14.544758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb671-3b58-4b14-bf00-7784dfaafcef service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:14.545042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb671-3b58-4b14-bf00-7784dfaafcef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:14.553339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccb671-3b58-4b14-bf00-7784dfaafcef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:14.554982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccb671-3b58-4b14-bf00-7784dfaafcef service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:14.564331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 720/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:15.444912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa626ee-455a-4878-905a-3758f16853ae None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:15.445467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa626ee-455a-4878-905a-3758f16853ae None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:15.445593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa626ee-455a-4878-905a-3758f16853ae None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:15.447065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:15.452414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceff92-bc83-4dcf-a0b3-8a042ac4aed4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:15.452856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceff92-bc83-4dcf-a0b3-8a042ac4aed4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:15.453015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceff92-bc83-4dcf-a0b3-8a042ac4aed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:15.471517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-51ceff92-bc83-4dcf-a0b3-8a042ac4aed4 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:15.472717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-51ceff92-bc83-4dcf-a0b3-8a042ac4aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:15.480584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:53:15.632888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa626ee-455a-4878-905a-3758f16853ae None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:15.647712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa626ee-455a-4878-905a-3758f16853ae None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:15.653128 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b835ef-8e2d-46aa-a541-d5a5482992cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:15.653803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b835ef-8e2d-46aa-a541-d5a5482992cb service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:15.654095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b835ef-8e2d-46aa-a541-d5a5482992cb service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:15.654373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b835ef-8e2d-46aa-a541-d5a5482992cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:15.662855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b835ef-8e2d-46aa-a541-d5a5482992cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:15.664690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b835ef-8e2d-46aa-a541-d5a5482992cb service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:15.673792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 719/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:17.846517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4735b4e-da68-450d-ac3b-9591b09f3573 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:17.847045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4735b4e-da68-450d-ac3b-9591b09f3573 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:17.847163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4735b4e-da68-450d-ac3b-9591b09f3573 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:17.848529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:17.854032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd655-a637-411f-86df-e4ad61f1007b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:17.854461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd655-a637-411f-86df-e4ad61f1007b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:17.854588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd655-a637-411f-86df-e4ad61f1007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:17.873003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d4fdd655-a637-411f-86df-e4ad61f1007b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:17.874258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d4fdd655-a637-411f-86df-e4ad61f1007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:17.882865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:17.921000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4735b4e-da68-450d-ac3b-9591b09f3573 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:17.932479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4735b4e-da68-450d-ac3b-9591b09f3573 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:17.936054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c4d86-9f91-4abe-b2d1-e63487796c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:17.936691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4d86-9f91-4abe-b2d1-e63487796c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:17.936978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4d86-9f91-4abe-b2d1-e63487796c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:17.937259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4d86-9f91-4abe-b2d1-e63487796c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:17.951582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c4d86-9f91-4abe-b2d1-e63487796c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:17.953019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c4d86-9f91-4abe-b2d1-e63487796c22 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:17.962792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 723/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:20.381534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5f100-145e-4a53-ac86-65543424532f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:20.382125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5f100-145e-4a53-ac86-65543424532f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:20.382125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5f100-145e-4a53-ac86-65543424532f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:20.383550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:20.388909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd1bd-8500-434e-a3d6-c2e437f4ae5d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:20.389520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd1bd-8500-434e-a3d6-c2e437f4ae5d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:20.389520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd1bd-8500-434e-a3d6-c2e437f4ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:20.409247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-392fd1bd-8500-434e-a3d6-c2e437f4ae5d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:20.411457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-392fd1bd-8500-434e-a3d6-c2e437f4ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:20.419668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:20.458496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5f100-145e-4a53-ac86-65543424532f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:20.469064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5f100-145e-4a53-ac86-65543424532f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:20.472604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19bc8-0733-4684-aec5-743395fbdaa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:20.473475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19bc8-0733-4684-aec5-743395fbdaa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:20.473798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19bc8-0733-4684-aec5-743395fbdaa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:20.474082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19bc8-0733-4684-aec5-743395fbdaa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:20.482922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19bc8-0733-4684-aec5-743395fbdaa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:20.484353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19bc8-0733-4684-aec5-743395fbdaa4 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:20.494189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 722/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:23.102051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb039619-585f-4509-a919-0e11603d07d9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:23.102643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb039619-585f-4509-a919-0e11603d07d9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:23.102643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb039619-585f-4509-a919-0e11603d07d9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:23.103986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:23.109352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a420-dfeb-4793-a715-ee609948ae60 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:23.109786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a420-dfeb-4793-a715-ee609948ae60 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:23.109942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a420-dfeb-4793-a715-ee609948ae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:23.128026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-00b0a420-dfeb-4793-a715-ee609948ae60 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:23.129271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-00b0a420-dfeb-4793-a715-ee609948ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:23.137123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:23.176393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb039619-585f-4509-a919-0e11603d07d9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:23.190500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb039619-585f-4509-a919-0e11603d07d9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:23.194659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd95914-8dbc-47be-ac5b-aff7d7c9a855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:23.195313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd95914-8dbc-47be-ac5b-aff7d7c9a855 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:23.195604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd95914-8dbc-47be-ac5b-aff7d7c9a855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:23.195889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd95914-8dbc-47be-ac5b-aff7d7c9a855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:23.205275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd95914-8dbc-47be-ac5b-aff7d7c9a855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:23.206767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd95914-8dbc-47be-ac5b-aff7d7c9a855 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:23.217182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 726/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:25.734160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4a2fe-4600-43b1-bab3-cba9b1b42023 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:25.734691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4a2fe-4600-43b1-bab3-cba9b1b42023 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:25.734691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4a2fe-4600-43b1-bab3-cba9b1b42023 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:25.736066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:25.741641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b774-1acf-4a54-8007-78ab90144015 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:25.742320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b774-1acf-4a54-8007-78ab90144015 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:25.742320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b774-1acf-4a54-8007-78ab90144015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:25.761443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6e73b774-1acf-4a54-8007-78ab90144015 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:25.762693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6e73b774-1acf-4a54-8007-78ab90144015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:25.771445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:25.809408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4a2fe-4600-43b1-bab3-cba9b1b42023 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:25.820631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4a2fe-4600-43b1-bab3-cba9b1b42023 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:25.824192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9164b-10a9-4a06-a537-ea3234a40a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:25.824838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9164b-10a9-4a06-a537-ea3234a40a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:25.825125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9164b-10a9-4a06-a537-ea3234a40a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:25.825408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9164b-10a9-4a06-a537-ea3234a40a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:25.835047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9164b-10a9-4a06-a537-ea3234a40a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:25.836468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9164b-10a9-4a06-a537-ea3234a40a37 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:25.845846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 725/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:28.185780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07ebd-115a-4794-abc9-11a4e5440031 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:28.186342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07ebd-115a-4794-abc9-11a4e5440031 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:28.186342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07ebd-115a-4794-abc9-11a4e5440031 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:28.187972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:28.194026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec411d-9d05-4b88-9d27-7efc8aa981eb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:28.194479 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec411d-9d05-4b88-9d27-7efc8aa981eb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:28.194582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec411d-9d05-4b88-9d27-7efc8aa981eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:28.213119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2fec411d-9d05-4b88-9d27-7efc8aa981eb None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:28.214366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2fec411d-9d05-4b88-9d27-7efc8aa981eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:28.222356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:28.261182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e07ebd-115a-4794-abc9-11a4e5440031 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:28.272700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e07ebd-115a-4794-abc9-11a4e5440031 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:28.276263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7620824-c29d-417c-b98e-383a407b5a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:28.276907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7620824-c29d-417c-b98e-383a407b5a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:28.277198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7620824-c29d-417c-b98e-383a407b5a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:28.277480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7620824-c29d-417c-b98e-383a407b5a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:28.286618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7620824-c29d-417c-b98e-383a407b5a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:28.288065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7620824-c29d-417c-b98e-383a407b5a10 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:28.297331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 729/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:30.622017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfdef-8af1-43b4-9e44-8800c7b9caf5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:30.622545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfdef-8af1-43b4-9e44-8800c7b9caf5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:30.622673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfdef-8af1-43b4-9e44-8800c7b9caf5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:30.624001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:30.629795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145bedb-a6e4-402f-ad75-a399b1274aa6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:30.630323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145bedb-a6e4-402f-ad75-a399b1274aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:30.630429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145bedb-a6e4-402f-ad75-a399b1274aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:30.647505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9145bedb-a6e4-402f-ad75-a399b1274aa6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:30.648692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9145bedb-a6e4-402f-ad75-a399b1274aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:30.656306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:30.695113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cfdef-8af1-43b4-9e44-8800c7b9caf5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:30.705867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cfdef-8af1-43b4-9e44-8800c7b9caf5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:30.709390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35a3b3-3a1e-4609-809e-92905ff45d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:30.710063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a3b3-3a1e-4609-809e-92905ff45d44 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:30.710353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a3b3-3a1e-4609-809e-92905ff45d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:30.710637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a3b3-3a1e-4609-809e-92905ff45d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:30.719512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35a3b3-3a1e-4609-809e-92905ff45d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:30.720926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35a3b3-3a1e-4609-809e-92905ff45d44 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:30.730403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 728/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:33.116003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc860d7-7870-4db4-b0b0-0e9b9475a4f3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:33.116598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc860d7-7870-4db4-b0b0-0e9b9475a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:33.116598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc860d7-7870-4db4-b0b0-0e9b9475a4f3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:33.118500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:33.125456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1223-4875-4a24-bd6d-5f728829c199 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:33.125941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1223-4875-4a24-bd6d-5f728829c199 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:33.126505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1223-4875-4a24-bd6d-5f728829c199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:33.135248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=70 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:53:33.150501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4d3c1223-4875-4a24-bd6d-5f728829c199 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:33.151721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4d3c1223-4875-4a24-bd6d-5f728829c199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:33.159706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:33.198292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc860d7-7870-4db4-b0b0-0e9b9475a4f3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:33.203691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=73 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:53:33.211117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc860d7-7870-4db4-b0b0-0e9b9475a4f3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:33.214695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1f8d-9f50-4b2b-b024-357e66351ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:33.215349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1f8d-9f50-4b2b-b024-357e66351ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:33.215639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1f8d-9f50-4b2b-b024-357e66351ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:33.215922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1f8d-9f50-4b2b-b024-357e66351ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:33.226277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1f8d-9f50-4b2b-b024-357e66351ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:33.227725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1f8d-9f50-4b2b-b024-357e66351ad3 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:33.237397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 732/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:35.570771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6a3a-b79c-409c-ba8d-c4808021d4d7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:35.571336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6a3a-b79c-409c-ba8d-c4808021d4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:35.571336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6a3a-b79c-409c-ba8d-c4808021d4d7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:35.572694 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:35.577991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb77e-e4d7-491a-b41b-06e3fb4251d6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:35.578412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb77e-e4d7-491a-b41b-06e3fb4251d6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:35.578582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb77e-e4d7-491a-b41b-06e3fb4251d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:35.597511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5b8eb77e-e4d7-491a-b41b-06e3fb4251d6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:35.598785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b8eb77e-e4d7-491a-b41b-06e3fb4251d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:35.606903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:35.645578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf6a3a-b79c-409c-ba8d-c4808021d4d7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:35.656320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf6a3a-b79c-409c-ba8d-c4808021d4d7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:35.659822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc90c-bc40-40e4-8f99-f52650f953c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:35.660880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc90c-bc40-40e4-8f99-f52650f953c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:35.661168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc90c-bc40-40e4-8f99-f52650f953c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:35.661447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc90c-bc40-40e4-8f99-f52650f953c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:35.670797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dc90c-bc40-40e4-8f99-f52650f953c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:35.672214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dc90c-bc40-40e4-8f99-f52650f953c2 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:35.681847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 731/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:37.989453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fec5-2310-4c4a-a169-57c78221338a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:37.990184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fec5-2310-4c4a-a169-57c78221338a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:37.990184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fec5-2310-4c4a-a169-57c78221338a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:37.991545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:37.997177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3756857-97c4-4033-ad73-81bff17a1292 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:37.997676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3756857-97c4-4033-ad73-81bff17a1292 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:37.997795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3756857-97c4-4033-ad73-81bff17a1292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:38.015509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f3756857-97c4-4033-ad73-81bff17a1292 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:38.016700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f3756857-97c4-4033-ad73-81bff17a1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:38.024529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:38.061478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511fec5-2310-4c4a-a169-57c78221338a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:38.072326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511fec5-2310-4c4a-a169-57c78221338a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:38.075859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4a619-6fac-41f0-9fc1-86071d262541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:38.076500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a619-6fac-41f0-9fc1-86071d262541 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:38.076789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a619-6fac-41f0-9fc1-86071d262541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:38.077072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a619-6fac-41f0-9fc1-86071d262541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:38.086925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4a619-6fac-41f0-9fc1-86071d262541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:38.088368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4a619-6fac-41f0-9fc1-86071d262541 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:38.098395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 735/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:53:40.437168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93db6-f93f-4448-a091-4c26770f32b1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:40.438022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93db6-f93f-4448-a091-4c26770f32b1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:40.438022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93db6-f93f-4448-a091-4c26770f32b1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:40.439697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:53:40.445127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc83d7-18de-4dc7-8422-5e1fff1dabbb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:40.445598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc83d7-18de-4dc7-8422-5e1fff1dabbb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:40.445728 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc83d7-18de-4dc7-8422-5e1fff1dabbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:40.463794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-46fc83d7-18de-4dc7-8422-5e1fff1dabbb None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:53:40.465005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-46fc83d7-18de-4dc7-8422-5e1fff1dabbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:53:40.473857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:53:40.510883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93db6-f93f-4448-a091-4c26770f32b1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:53:40.521994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93db6-f93f-4448-a091-4c26770f32b1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:53:40.525482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc711b-8b1f-46f4-acc5-4c4cb3772266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:53:40.526152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc711b-8b1f-46f4-acc5-4c4cb3772266 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:53:40.526439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc711b-8b1f-46f4-acc5-4c4cb3772266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:53:40.526719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc711b-8b1f-46f4-acc5-4c4cb3772266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:53:40.536351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc711b-8b1f-46f4-acc5-4c4cb3772266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:53:40.538200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc711b-8b1f-46f4-acc5-4c4cb3772266 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:53:40.547958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 734/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:53:50.458564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=17 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:53:50.543519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=17 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:54:12.809112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d635ebe-b63a-4985-a5fd-c394ae6858da None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:12.809735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d635ebe-b63a-4985-a5fd-c394ae6858da None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:12.809735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d635ebe-b63a-4985-a5fd-c394ae6858da None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:12.811217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 737/1471] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:54:12.816570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2ec2-985e-4203-a658-55110ca10bcb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:12.817027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2ec2-985e-4203-a658-55110ca10bcb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:12.817366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2ec2-985e-4203-a658-55110ca10bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:12.836637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-78cb2ec2-985e-4203-a658-55110ca10bcb None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:54:12.837806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-78cb2ec2-985e-4203-a658-55110ca10bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:54:12.846261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 735/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:54:12.895036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea71eb-2738-495b-8cd3-b773f57380ac None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:12.895327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea71eb-2738-495b-8cd3-b773f57380ac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:12.895613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea71eb-2738-495b-8cd3-b773f57380ac None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:12.896986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 738/1473] 10.222.0.46 () {54 vars in 962 bytes} [Wed Jun 8 12:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:54:12.902042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305cc5-e825-4c07-876f-2c5283c463f1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:12.902337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305cc5-e825-4c07-876f-2c5283c463f1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:12.902626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305cc5-e825-4c07-876f-2c5283c463f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:12.920870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-28305cc5-e825-4c07-876f-2c5283c463f1 None None] MFA Rules not processed for user `998c7b05ebe64f5c95bcb86a49e673ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:54:12.922092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-28305cc5-e825-4c07-876f-2c5283c463f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:54:12.928501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 736/1474] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Jun 8 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:54:12.935762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea71eb-2738-495b-8cd3-b773f57380ac None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:54:12.947173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea71eb-2738-495b-8cd3-b773f57380ac None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:54:12.950720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933816b1-c09d-428b-9932-75f94e507cbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:54:12.951352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933816b1-c09d-428b-9932-75f94e507cbe service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:12.951639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933816b1-c09d-428b-9932-75f94e507cbe service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:12.951974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933816b1-c09d-428b-9932-75f94e507cbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:12.961999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933816b1-c09d-428b-9932-75f94e507cbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:54:12.963433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933816b1-c09d-428b-9932-75f94e507cbe service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:54:12.972775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 739/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:54:15.378604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327efe5-3731-4ae7-852b-97059461963a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:15.379132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327efe5-3731-4ae7-852b-97059461963a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:15.379132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327efe5-3731-4ae7-852b-97059461963a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:15.380444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 737/1476] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:54:15.385979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdcdb0-8698-4f77-a8b2-dcb637f29d27 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:15.386419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdcdb0-8698-4f77-a8b2-dcb637f29d27 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:15.386604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdcdb0-8698-4f77-a8b2-dcb637f29d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:15.406014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b5cdcdb0-8698-4f77-a8b2-dcb637f29d27 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:54:15.407224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b5cdcdb0-8698-4f77-a8b2-dcb637f29d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:54:15.415282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 740/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:54:15.439060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327efe5-3731-4ae7-852b-97059461963a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:54:15.454384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327efe5-3731-4ae7-852b-97059461963a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:54:15.461357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe7477-bcc6-4c5e-ad81-20f41d777f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:54:15.462140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7477-bcc6-4c5e-ad81-20f41d777f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:15.462440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7477-bcc6-4c5e-ad81-20f41d777f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:15.462729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7477-bcc6-4c5e-ad81-20f41d777f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:15.463523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe7477-bcc6-4c5e-ad81-20f41d777f70 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:54:15.465419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-6afe7477-bcc6-4c5e-ad81-20f41d777f70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:54:15.465419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jun 08 12:54:15.465419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: Jun 08 12:54:15.466659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe7477-bcc6-4c5e-ad81-20f41d777f70 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:54:15.494648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 738/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 8 12:54:15 2022] GET /identity/v3/projects => generated 2553 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:54:17.800086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b6a08-7710-4e93-989b-2f54b4f73dbb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:17.800819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b6a08-7710-4e93-989b-2f54b4f73dbb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:17.801020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b6a08-7710-4e93-989b-2f54b4f73dbb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:17.802984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 741/1479] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:54:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:54:17.809011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f05bf2-58b3-4c68-bf9e-7c0ec5573dbb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:17.809442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f05bf2-58b3-4c68-bf9e-7c0ec5573dbb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:17.809640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f05bf2-58b3-4c68-bf9e-7c0ec5573dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:17.828457 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b7f05bf2-58b3-4c68-bf9e-7c0ec5573dbb None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:54:17.829723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b7f05bf2-58b3-4c68-bf9e-7c0ec5573dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:54:17.839833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 739/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:54:17.885879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b6a08-7710-4e93-989b-2f54b4f73dbb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:54:17.900689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b6a08-7710-4e93-989b-2f54b4f73dbb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:54:17.906072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63495a05-7fd4-4dad-8044-42700949f2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:54:17.906712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495a05-7fd4-4dad-8044-42700949f2a2 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:17.906995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495a05-7fd4-4dad-8044-42700949f2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:17.907269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63495a05-7fd4-4dad-8044-42700949f2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:17.916537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63495a05-7fd4-4dad-8044-42700949f2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:54:17.918158 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63495a05-7fd4-4dad-8044-42700949f2a2 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:54:17.928100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 742/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:54:20.383478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195cc8-0dcd-4adb-a0a1-e7db4e337492 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:20.384048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195cc8-0dcd-4adb-a0a1-e7db4e337492 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:20.384048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195cc8-0dcd-4adb-a0a1-e7db4e337492 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:20.385455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 740/1482] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:54:20.390887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea044e8-25c7-49ef-94ec-50d767706013 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:20.391331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea044e8-25c7-49ef-94ec-50d767706013 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:20.391458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea044e8-25c7-49ef-94ec-50d767706013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:20.411003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6ea044e8-25c7-49ef-94ec-50d767706013 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:54:20.412299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6ea044e8-25c7-49ef-94ec-50d767706013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:54:20.420198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 743/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:54:20.457529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195cc8-0dcd-4adb-a0a1-e7db4e337492 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:54:20.468186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195cc8-0dcd-4adb-a0a1-e7db4e337492 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:54:20.471937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69790-a7f8-4af9-994a-bc1d5ca43280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:54:20.472589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69790-a7f8-4af9-994a-bc1d5ca43280 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:20.472875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69790-a7f8-4af9-994a-bc1d5ca43280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:20.473151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69790-a7f8-4af9-994a-bc1d5ca43280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:20.482052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea69790-a7f8-4af9-994a-bc1d5ca43280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:54:20.483483 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea69790-a7f8-4af9-994a-bc1d5ca43280 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:54:20.493364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 741/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:54:22.801270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ed16-76b5-4dea-8025-7cc163355f93 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:22.801831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ed16-76b5-4dea-8025-7cc163355f93 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:22.801831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ed16-76b5-4dea-8025-7cc163355f93 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:22.803236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 744/1485] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:54:22.808797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4594f-114f-404e-9808-a046b3405f13 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:22.809255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4594f-114f-404e-9808-a046b3405f13 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:22.809367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4594f-114f-404e-9808-a046b3405f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:22.827397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4cc4594f-114f-404e-9808-a046b3405f13 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:54:22.828592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4cc4594f-114f-404e-9808-a046b3405f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:54:22.837831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 742/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:54:22.875516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55ed16-76b5-4dea-8025-7cc163355f93 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:54:22.886859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55ed16-76b5-4dea-8025-7cc163355f93 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:54:22.890327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55529d6-1cdd-4869-a028-1d6d611a890b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:54:22.890962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55529d6-1cdd-4869-a028-1d6d611a890b service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:22.891252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55529d6-1cdd-4869-a028-1d6d611a890b service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:22.891529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55529d6-1cdd-4869-a028-1d6d611a890b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:22.901165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55529d6-1cdd-4869-a028-1d6d611a890b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:54:22.902627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55529d6-1cdd-4869-a028-1d6d611a890b service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:54:22.911974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 745/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:54:25.415399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b881-9c7a-45c1-87a2-52d51814a298 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:25.415875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b881-9c7a-45c1-87a2-52d51814a298 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:25.415980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b881-9c7a-45c1-87a2-52d51814a298 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:25.417347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 743/1488] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:54:25.422691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c406-56df-4ab7-a9b3-f7d75c4c7bc8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:25.423118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c406-56df-4ab7-a9b3-f7d75c4c7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:25.423261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c406-56df-4ab7-a9b3-f7d75c4c7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:25.440915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5f22c406-56df-4ab7-a9b3-f7d75c4c7bc8 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:54:25.442153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5f22c406-56df-4ab7-a9b3-f7d75c4c7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:54:25.457958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 746/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:54:25.502005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b881-9c7a-45c1-87a2-52d51814a298 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:54:25.525116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b881-9c7a-45c1-87a2-52d51814a298 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:54:25.528956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cba71-0b62-4585-8608-ca50210bc145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:54:25.530456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cba71-0b62-4585-8608-ca50210bc145 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:25.530738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cba71-0b62-4585-8608-ca50210bc145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:25.531013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cba71-0b62-4585-8608-ca50210bc145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:25.541076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cba71-0b62-4585-8608-ca50210bc145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:54:25.542526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cba71-0b62-4585-8608-ca50210bc145 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:54:25.552079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 744/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:54:28.010368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3008-30af-41a5-b855-d082715f0557 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:28.010925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3008-30af-41a5-b855-d082715f0557 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:28.010925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3008-30af-41a5-b855-d082715f0557 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:28.012279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 747/1491] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 8 12:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:54:28.017467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda0f5-6969-4bd5-8cad-d192dc948dee None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:28.017965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda0f5-6969-4bd5-8cad-d192dc948dee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:28.018141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda0f5-6969-4bd5-8cad-d192dc948dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:28.036319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3acda0f5-6969-4bd5-8cad-d192dc948dee None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:54:28.037459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3acda0f5-6969-4bd5-8cad-d192dc948dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:54:28.045326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 745/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 8 12:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:54:28.084682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b3008-30af-41a5-b855-d082715f0557 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:54:28.095302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b3008-30af-41a5-b855-d082715f0557 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:54:28.100367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c0f56-1b7c-419c-bf59-05b5a250011a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:54:28.100992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c0f56-1b7c-419c-bf59-05b5a250011a service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:54:28.101284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c0f56-1b7c-419c-bf59-05b5a250011a service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:54:28.101586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c0f56-1b7c-419c-bf59-05b5a250011a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:54:28.112499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c0f56-1b7c-419c-bf59-05b5a250011a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:54:28.114491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c0f56-1b7c-419c-bf59-05b5a250011a service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:54:28.126960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 748/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:54:38.031126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=33 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:54:38.122414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=33 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:56:01.559744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bedc5-16aa-4d95-b68c-c135aa1fd122 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.560340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bedc5-16aa-4d95-b68c-c135aa1fd122 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.560340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bedc5-16aa-4d95-b68c-c135aa1fd122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:01.578807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a12bedc5-16aa-4d95-b68c-c135aa1fd122 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:56:01.580125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a12bedc5-16aa-4d95-b68c-c135aa1fd122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:56:01.588516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 746/1494] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:56:01.597408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35ddb-c4c5-4f5b-b85a-8cd9fdb0fe8f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.597931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35ddb-c4c5-4f5b-b85a-8cd9fdb0fe8f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.598039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35ddb-c4c5-4f5b-b85a-8cd9fdb0fe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:01.615890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-94b35ddb-c4c5-4f5b-b85a-8cd9fdb0fe8f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:56:01.617092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94b35ddb-c4c5-4f5b-b85a-8cd9fdb0fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:56:01.629472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 749/1495] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:56:01.634622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bedc5-16aa-4d95-b68c-c135aa1fd122 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:01.645007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bedc5-16aa-4d95-b68c-c135aa1fd122 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:01.649677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:01.650345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.650636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.650921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:01.651650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:56:01.651984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:01.652985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:56:01.652985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jun 08 12:56:01.652985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: Jun 08 12:56:01.653907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:01.666389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 747/1496] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:56:01.674595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b35ddb-c4c5-4f5b-b85a-8cd9fdb0fe8f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:01.683899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b35ddb-c4c5-4f5b-b85a-8cd9fdb0fe8f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:01.689050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:01.689737 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.690030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.690311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:01.691001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:01.692731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING py.warnings [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:56:01.692731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: warnings.warn(msg) Jun 08 12:56:01.692731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: Jun 08 12:56:01.693954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:01.732437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 750/1497] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:56:01 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:56:01.736614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:01.746689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e066a5-dec2-4dbb-984a-74e10264fc37 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:01.810236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:01.811050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.811345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.811651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:01.813090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:01.814136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:56:01.814136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jun 08 12:56:01.814136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: Jun 08 12:56:01.815356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:01.835994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 748/1498] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:56:01 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:56:01.840054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:01.850563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a070a-9d64-4787-945e-757371405c60 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:01.855167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:01.855834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.856125 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.856412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:01.857147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:01.858204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING py.warnings [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:56:01.858204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: warnings.warn(msg) Jun 08 12:56:01.858204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: Jun 08 12:56:01.859283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:01.872188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 751/1499] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:56:01.876652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:01.887232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c9d6-dfd1-47c7-bde5-ffa81ec68b90 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:01.892073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45813b4c-a02e-41a2-9037-cf22f6f4013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:01.892759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813b4c-a02e-41a2-9037-cf22f6f4013a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.893044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813b4c-a02e-41a2-9037-cf22f6f4013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.893327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813b4c-a02e-41a2-9037-cf22f6f4013a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:01.894081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45813b4c-a02e-41a2-9037-cf22f6f4013a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:01.895090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-45813b4c-a02e-41a2-9037-cf22f6f4013a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:56:01.895090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jun 08 12:56:01.895090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: Jun 08 12:56:01.896004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45813b4c-a02e-41a2-9037-cf22f6f4013a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:01.910448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 749/1500] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:56:01.914597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:01.925576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bff78-27f3-4f30-b033-b3d0500cee3b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:01.930061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cac7fc-2ef0-4264-9a08-6dfd188d67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:01.930944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cac7fc-2ef0-4264-9a08-6dfd188d67a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.931247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cac7fc-2ef0-4264-9a08-6dfd188d67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.931535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cac7fc-2ef0-4264-9a08-6dfd188d67a5 admin admin] PATH_INFO: `/v3/projects/eb3d86b5783a4e33b7ce5b2ae65f7a6b/users/77d19f6801f34917b7011f44563ee293/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:01.945868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cac7fc-2ef0-4264-9a08-6dfd188d67a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3d86b5783a4e33b7ce5b2ae65f7a6b, user_id=77d19f6801f34917b7011f44563ee293, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:01.946903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING py.warnings [None req-e1cac7fc-2ef0-4264-9a08-6dfd188d67a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:56:01.946903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: warnings.warn(msg) Jun 08 12:56:01.946903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: Jun 08 12:56:01.948830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cac7fc-2ef0-4264-9a08-6dfd188d67a5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:01.961383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 752/1501] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:56:01 2022] PUT /identity/v3/projects/eb3d86b5783a4e33b7ce5b2ae65f7a6b/users/77d19f6801f34917b7011f44563ee293/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:56:01.974274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aba59-f267-45ca-981a-c34189efec20 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:01.974573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aba59-f267-45ca-981a-c34189efec20 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:01.974860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aba59-f267-45ca-981a-c34189efec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.001676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-632aba59-f267-45ca-981a-c34189efec20 None None] MFA Rules not processed for user `77d19f6801f34917b7011f44563ee293`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:56:02.002895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-632aba59-f267-45ca-981a-c34189efec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:56:02.066817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 750/1502] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:56:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:56:02.079860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329130df-d471-435f-8281-c63cb59d5e83 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:02.080298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329130df-d471-435f-8281-c63cb59d5e83 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:02.080588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329130df-d471-435f-8281-c63cb59d5e83 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.082023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 753/1503] 10.222.0.46 () {54 vars in 963 bytes} [Wed Jun 8 12:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:56:02.086744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15e4ad-9f75-423d-9078-bed40b689068 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:02.087045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15e4ad-9f75-423d-9078-bed40b689068 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:02.087331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15e4ad-9f75-423d-9078-bed40b689068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.104966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5a15e4ad-9f75-423d-9078-bed40b689068 None None] MFA Rules not processed for user `d83990f7249442a582403e654a2278f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:56:02.106229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a15e4ad-9f75-423d-9078-bed40b689068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:56:02.153713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:56:02.162380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 751/1504] 10.222.0.46 () {58 vars in 1060 bytes} [Wed Jun 8 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:56:02.170046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329130df-d471-435f-8281-c63cb59d5e83 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:02.181269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329130df-d471-435f-8281-c63cb59d5e83 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:02.184782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e1a01-d545-4395-9c75-8afbeb282fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:02.185418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1a01-d545-4395-9c75-8afbeb282fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:02.185745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1a01-d545-4395-9c75-8afbeb282fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:02.186034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1a01-d545-4395-9c75-8afbeb282fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.194271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e1a01-d545-4395-9c75-8afbeb282fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:02.195715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e1a01-d545-4395-9c75-8afbeb282fc2 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:02.205161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 754/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:56:02.247289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a02c13-8915-49d8-8451-6214a6407708 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:02.247606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a02c13-8915-49d8-8451-6214a6407708 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:02.247869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a02c13-8915-49d8-8451-6214a6407708 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.249167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 752/1506] 10.222.0.46 () {52 vars in 829 bytes} [Wed Jun 8 12:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:56:02.252817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e1a01-d545-4395-9c75-8afbeb282fc2 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:02.315342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e1a01-d545-4395-9c75-8afbeb282fc2 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:02.319849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:02.320716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:02.321006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:02.321280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] PATH_INFO: `/v3/users/77d19f6801f34917b7011f44563ee293` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.322475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d19f6801f34917b7011f44563ee293)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:02.323486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING py.warnings [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:56:02.323486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: warnings.warn(msg) Jun 08 12:56:02.323486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: Jun 08 12:56:02.324694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:02.393243 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d19f6801f34917b7011f44563ee293'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:02.393986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d19f6801f34917b7011f44563ee293'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:02.403596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d19f6801f34917b7011f44563ee293'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:02.424318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d19f6801f34917b7011f44563ee293'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:02.432604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:56:02.438163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d19f6801f34917b7011f44563ee293'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:02.445492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 755/1507] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 12:56:02 2022] DELETE /identity/v3/users/77d19f6801f34917b7011f44563ee293 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:56:02.450042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f886ff-f3e2-40ae-904e-0688cd6e2f42 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:02.450337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f886ff-f3e2-40ae-904e-0688cd6e2f42 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:02.450617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f886ff-f3e2-40ae-904e-0688cd6e2f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.468534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-95f886ff-f3e2-40ae-904e-0688cd6e2f42 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:56:02.469773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-95f886ff-f3e2-40ae-904e-0688cd6e2f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:56:02.528439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 753/1508] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:56:02.538076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:02.539496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:56:02.598021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bff3de-de63-4324-ad4c-9e4f8bad46bb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:02.601703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb706f47-b551-4432-a933-61ec376d6784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:02.602356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706f47-b551-4432-a933-61ec376d6784 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:02.602648 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706f47-b551-4432-a933-61ec376d6784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:02.602932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706f47-b551-4432-a933-61ec376d6784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.612158 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb706f47-b551-4432-a933-61ec376d6784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:02.613680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb706f47-b551-4432-a933-61ec376d6784 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:02.623447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 756/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:56:02.961284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f886ff-f3e2-40ae-904e-0688cd6e2f42 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:56:02.962745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-95f886ff-f3e2-40ae-904e-0688cd6e2f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:56:02.975260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f886ff-f3e2-40ae-904e-0688cd6e2f42 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:56:02.980116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:56:02.980998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:56:02.981349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:56:02.981727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] PATH_INFO: `/v3/projects/eb3d86b5783a4e33b7ce5b2ae65f7a6b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:56:02.982981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3d86b5783a4e33b7ce5b2ae65f7a6b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:56:02.984220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:56:02.984220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jun 08 12:56:02.984220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: Jun 08 12:56:02.985302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:56:03.048362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3d86b5783a4e33b7ce5b2ae65f7a6b', 'request_id': 'req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:03.061305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3d86b5783a4e33b7ce5b2ae65f7a6b', 'request_id': 'req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:03.071315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3d86b5783a4e33b7ce5b2ae65f7a6b', 'request_id': 'req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:03.082613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] The token cache is being invalidate because project eb3d86b5783a4e33b7ce5b2ae65f7a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:56:03.082905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:03.083637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cc00ec8a-1e8e-4b97-b314-03f48c04ee48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:56:03.085195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 754/1510] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 12:56:02 2022] DELETE /identity/v3/projects/eb3d86b5783a4e33b7ce5b2ae65f7a6b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:56:12.619398 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=29 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:56:13.079596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:57:40.318540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3658-ba7c-4af8-8c0f-09f8089a15cd None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:40.319098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3658-ba7c-4af8-8c0f-09f8089a15cd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:40.319098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3658-ba7c-4af8-8c0f-09f8089a15cd None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:40.320395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:57:40.325126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53664-dd13-40fc-9743-ccf71ea2f8db None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:40.325603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53664-dd13-40fc-9743-ccf71ea2f8db None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:40.325712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53664-dd13-40fc-9743-ccf71ea2f8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:40.343397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3ac53664-dd13-40fc-9743-ccf71ea2f8db None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:57:40.344596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3ac53664-dd13-40fc-9743-ccf71ea2f8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:40.403280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:57:40.571882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b3658-ba7c-4af8-8c0f-09f8089a15cd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:57:40.573612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7c6b3658-ba7c-4af8-8c0f-09f8089a15cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:40.648012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b3658-ba7c-4af8-8c0f-09f8089a15cd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:57:40.654259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a1125-a9a8-4154-a683-1a37d9be2acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:57:40.654923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1125-a9a8-4154-a683-1a37d9be2acf service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:40.655214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1125-a9a8-4154-a683-1a37d9be2acf service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:40.655498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1125-a9a8-4154-a683-1a37d9be2acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:40.663991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a1125-a9a8-4154-a683-1a37d9be2acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:57:40.665629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a1125-a9a8-4154-a683-1a37d9be2acf service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:57:40.676040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 758/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:57:41.570940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badb7e1-0a40-4262-8d2e-6a3b3c873a11 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:41.571514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badb7e1-0a40-4262-8d2e-6a3b3c873a11 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:41.571630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badb7e1-0a40-4262-8d2e-6a3b3c873a11 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:41.573410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:57:41.579080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206be72-c6e0-4a0b-a348-4219a808d7be None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:41.579526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206be72-c6e0-4a0b-a348-4219a808d7be None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:41.579651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206be72-c6e0-4a0b-a348-4219a808d7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:41.598671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b206be72-c6e0-4a0b-a348-4219a808d7be None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:57:41.599901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b206be72-c6e0-4a0b-a348-4219a808d7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:41.608322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:57:41.770010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badb7e1-0a40-4262-8d2e-6a3b3c873a11 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:57:41.788018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badb7e1-0a40-4262-8d2e-6a3b3c873a11 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:57:41.794822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505c0b3-8506-43e3-966b-10096d3fac86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:57:41.795465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c0b3-8506-43e3-966b-10096d3fac86 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:41.795756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c0b3-8506-43e3-966b-10096d3fac86 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:41.796038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c0b3-8506-43e3-966b-10096d3fac86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:41.804560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c0b3-8506-43e3-966b-10096d3fac86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:57:41.806200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c0b3-8506-43e3-966b-10096d3fac86 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:57:41.816168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 757/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:57:42.139411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721aff-c1d6-4fb5-9d8b-0bfa27d84652 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:42.139701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721aff-c1d6-4fb5-9d8b-0bfa27d84652 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:42.139989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721aff-c1d6-4fb5-9d8b-0bfa27d84652 None None] PATH_INFO: `/v3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:42.141304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 760/1517] 10.222.0.40 () {54 vars in 925 bytes} [Wed Jun 8 12:57:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:57:42.149716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d23c2-1115-46a5-b6a2-9b500973658a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:42.150012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d23c2-1115-46a5-b6a2-9b500973658a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:42.150377 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d23c2-1115-46a5-b6a2-9b500973658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:42.170805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c71d23c2-1115-46a5-b6a2-9b500973658a None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:57:42.172022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c71d23c2-1115-46a5-b6a2-9b500973658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:42.235194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 758/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jun 8 12:57:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:57:46.318566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e549-8e59-4fcc-9aac-1051dfd2b798 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:46.319164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e549-8e59-4fcc-9aac-1051dfd2b798 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:46.319164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e549-8e59-4fcc-9aac-1051dfd2b798 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:46.320513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 761/1519] 10.222.0.46 () {54 vars in 960 bytes} [Wed Jun 8 12:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:57:46.326265 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39f03-8679-48cd-8a71-2c4014577b80 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:46.326961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39f03-8679-48cd-8a71-2c4014577b80 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:46.326961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39f03-8679-48cd-8a71-2c4014577b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:46.346022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bfd39f03-8679-48cd-8a71-2c4014577b80 None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:57:46.347259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bfd39f03-8679-48cd-8a71-2c4014577b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:46.356372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 759/1520] 10.222.0.46 () {58 vars in 1057 bytes} [Wed Jun 8 12:57:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:57:46.364323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83e549-8e59-4fcc-9aac-1051dfd2b798 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:57:46.378385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83e549-8e59-4fcc-9aac-1051dfd2b798 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:57:46.383389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b0012-7e9f-4b02-ae26-fcbc5d9990af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:57:46.384033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b0012-7e9f-4b02-ae26-fcbc5d9990af service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:46.384325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b0012-7e9f-4b02-ae26-fcbc5d9990af service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:46.384611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b0012-7e9f-4b02-ae26-fcbc5d9990af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:46.394540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b0012-7e9f-4b02-ae26-fcbc5d9990af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:57:46.396550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b0012-7e9f-4b02-ae26-fcbc5d9990af service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:57:46.408141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 762/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:57:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:57:53.143130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b12f6-1182-41b2-9829-93149f7ed211 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:53.143848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b12f6-1182-41b2-9829-93149f7ed211 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:53.143848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b12f6-1182-41b2-9829-93149f7ed211 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:53.145147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:57:53.150568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27871c-0188-403e-be08-78274eb0682d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:53.151048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27871c-0188-403e-be08-78274eb0682d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:53.151154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27871c-0188-403e-be08-78274eb0682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:53.171215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8d27871c-0188-403e-be08-78274eb0682d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:57:53.172441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8d27871c-0188-403e-be08-78274eb0682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:53.180652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:57:53.337512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b12f6-1182-41b2-9829-93149f7ed211 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:57:53.352574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b12f6-1182-41b2-9829-93149f7ed211 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:57:53.358792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0911df-3bb7-49e5-8232-72fdc5c59fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:57:53.359464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0911df-3bb7-49e5-8232-72fdc5c59fb6 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:53.359767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0911df-3bb7-49e5-8232-72fdc5c59fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:53.360030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0911df-3bb7-49e5-8232-72fdc5c59fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:53.369169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0911df-3bb7-49e5-8232-72fdc5c59fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:57:53.370804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0911df-3bb7-49e5-8232-72fdc5c59fb6 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:57:53.381364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 761/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:57:54.273881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e98a3-bd4e-4fca-863c-3e5bf215fafc None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:54.274419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e98a3-bd4e-4fca-863c-3e5bf215fafc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:54.274419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e98a3-bd4e-4fca-863c-3e5bf215fafc None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:54.275748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:57:54.280689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c75a7-5edf-45d9-9e18-221ec75e0e2e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:54.281264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c75a7-5edf-45d9-9e18-221ec75e0e2e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:54.281264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c75a7-5edf-45d9-9e18-221ec75e0e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:54.301500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b11c75a7-5edf-45d9-9e18-221ec75e0e2e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:57:54.302736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b11c75a7-5edf-45d9-9e18-221ec75e0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:54.311522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:57:54.474739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e98a3-bd4e-4fca-863c-3e5bf215fafc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:57:54.489911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e98a3-bd4e-4fca-863c-3e5bf215fafc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:57:54.495561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9deccc-89a5-4bba-b045-76c72c0c2062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:57:54.496206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9deccc-89a5-4bba-b045-76c72c0c2062 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:54.496512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9deccc-89a5-4bba-b045-76c72c0c2062 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:54.496773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9deccc-89a5-4bba-b045-76c72c0c2062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:54.504973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9deccc-89a5-4bba-b045-76c72c0c2062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:57:54.506588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9deccc-89a5-4bba-b045-76c72c0c2062 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:57:54.517087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 765/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:57:58.828779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5885-6f05-40cd-89ec-fa8075659186 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:58.829345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5885-6f05-40cd-89ec-fa8075659186 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:58.829345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5885-6f05-40cd-89ec-fa8075659186 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:58.830795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:57:58.836436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3dec0-4a07-4057-a137-3ae7542fb1d6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:58.836879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3dec0-4a07-4057-a137-3ae7542fb1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:58.837003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3dec0-4a07-4057-a137-3ae7542fb1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:58.855561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-11f3dec0-4a07-4057-a137-3ae7542fb1d6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:57:58.857383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-11f3dec0-4a07-4057-a137-3ae7542fb1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:58.865185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:57:58.902057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee5885-6f05-40cd-89ec-fa8075659186 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:57:58.904302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7fee5885-6f05-40cd-89ec-fa8075659186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:57:58.961300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee5885-6f05-40cd-89ec-fa8075659186 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:57:58.964883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59593c-72db-4455-ae17-4d0fc1bb34bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:57:58.966055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59593c-72db-4455-ae17-4d0fc1bb34bd service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:57:58.966342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59593c-72db-4455-ae17-4d0fc1bb34bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:57:58.966713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59593c-72db-4455-ae17-4d0fc1bb34bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:57:58.975538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59593c-72db-4455-ae17-4d0fc1bb34bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:57:58.976966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59593c-72db-4455-ae17-4d0fc1bb34bd service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:57:58.982660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:57:58.988005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 764/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:58:01.208759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f283b-0865-4ad0-ae3b-7d46e63e2b88 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:01.209371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f283b-0865-4ad0-ae3b-7d46e63e2b88 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:01.209371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f283b-0865-4ad0-ae3b-7d46e63e2b88 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:01.210746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:58:01.216525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12efe91-294f-4139-aa7a-ddb61ace483c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:01.216999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12efe91-294f-4139-aa7a-ddb61ace483c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:01.217104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12efe91-294f-4139-aa7a-ddb61ace483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:01.235308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d12efe91-294f-4139-aa7a-ddb61ace483c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:58:01.236490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d12efe91-294f-4139-aa7a-ddb61ace483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:58:01.244453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:58:01.283002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f283b-0865-4ad0-ae3b-7d46e63e2b88 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:58:01.285213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe3f283b-0865-4ad0-ae3b-7d46e63e2b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:58:01.298531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f283b-0865-4ad0-ae3b-7d46e63e2b88 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:58:01.302116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf629182-437f-4c00-96b4-aa6eab0087ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:58:01.302762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629182-437f-4c00-96b4-aa6eab0087ca service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:01.303054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629182-437f-4c00-96b4-aa6eab0087ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:01.303341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629182-437f-4c00-96b4-aa6eab0087ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:01.312308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf629182-437f-4c00-96b4-aa6eab0087ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:58:01.313785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf629182-437f-4c00-96b4-aa6eab0087ca service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:58:01.323244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 768/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:58:05.155100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7483-a6f2-4020-90ac-29c671f38fe9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:05.155642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7483-a6f2-4020-90ac-29c671f38fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:05.155642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7483-a6f2-4020-90ac-29c671f38fe9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:05.157048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:58:05.162323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32ca2-2928-46cc-b65d-17b19c972502 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:05.162810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32ca2-2928-46cc-b65d-17b19c972502 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:05.162918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32ca2-2928-46cc-b65d-17b19c972502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:05.169228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=62 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:58:05.182224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-67d32ca2-2928-46cc-b65d-17b19c972502 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:58:05.183443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-67d32ca2-2928-46cc-b65d-17b19c972502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:58:05.192737 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:58:05.469470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7483-a6f2-4020-90ac-29c671f38fe9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:58:05.471226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6d6c7483-a6f2-4020-90ac-29c671f38fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:58:05.531185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7483-a6f2-4020-90ac-29c671f38fe9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:58:05.534805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3536f-8b04-4ba8-a5b9-45d5d92d3878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:58:05.535461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3536f-8b04-4ba8-a5b9-45d5d92d3878 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:05.535752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3536f-8b04-4ba8-a5b9-45d5d92d3878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:05.536036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3536f-8b04-4ba8-a5b9-45d5d92d3878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:05.545859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3536f-8b04-4ba8-a5b9-45d5d92d3878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:58:05.547297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3536f-8b04-4ba8-a5b9-45d5d92d3878 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:58:05.556802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 767/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:58:07.851796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4145-9960-4593-86e1-9f2eded358c0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:07.852416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4145-9960-4593-86e1-9f2eded358c0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:07.852416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4145-9960-4593-86e1-9f2eded358c0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:07.853823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:58:07.859618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727561-6d53-426c-9e82-6a3420a5bf91 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:07.860040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727561-6d53-426c-9e82-6a3420a5bf91 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:07.860329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727561-6d53-426c-9e82-6a3420a5bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:07.881416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-18727561-6d53-426c-9e82-6a3420a5bf91 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:58:07.882656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18727561-6d53-426c-9e82-6a3420a5bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:58:07.891442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:58:08.175223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a4145-9960-4593-86e1-9f2eded358c0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:58:08.176945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b36a4145-9960-4593-86e1-9f2eded358c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:58:08.190749 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a4145-9960-4593-86e1-9f2eded358c0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:58:08.194333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad784e83-376c-45d2-901b-6c1c7ff62b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:58:08.194984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad784e83-376c-45d2-901b-6c1c7ff62b14 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:58:08.195274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad784e83-376c-45d2-901b-6c1c7ff62b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:58:08.195559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad784e83-376c-45d2-901b-6c1c7ff62b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:58:08.204815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad784e83-376c-45d2-901b-6c1c7ff62b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:58:08.206311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad784e83-376c-45d2-901b-6c1c7ff62b14 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:58:08.216250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 771/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:58:17.875965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=32 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:58:18.211782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=8 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:39.199107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5ac0-56e2-4f16-8723-c187281b102c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.200300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5ac0-56e2-4f16-8723-c187281b102c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.200896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5ac0-56e2-4f16-8723-c187281b102c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.230648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ab2f5ac0-56e2-4f16-8723-c187281b102c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:39.232275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ab2f5ac0-56e2-4f16-8723-c187281b102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:39.243133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 769/1540] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:39.253663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55113d-1695-4031-b6c9-b01128cf0ea8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.254651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55113d-1695-4031-b6c9-b01128cf0ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.255141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55113d-1695-4031-b6c9-b01128cf0ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.287401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9d55113d-1695-4031-b6c9-b01128cf0ea8 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:39.289335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9d55113d-1695-4031-b6c9-b01128cf0ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:39.303161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 772/1541] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:39.309917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f5ac0-56e2-4f16-8723-c187281b102c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:39.322885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f5ac0-56e2-4f16-8723-c187281b102c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:39.329430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:39.330509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.331003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.331484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.332435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:39.332955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:39.334971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:39.357448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 770/1542] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:39.366781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55113d-1695-4031-b6c9-b01128cf0ea8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:39.378573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55113d-1695-4031-b6c9-b01128cf0ea8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:39.389490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596b2b1-6e59-45b3-a34a-35fe7ed2a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:39.390241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b2b1-6e59-45b3-a34a-35fe7ed2a75c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.390517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b2b1-6e59-45b3-a34a-35fe7ed2a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.390804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b2b1-6e59-45b3-a34a-35fe7ed2a75c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.394649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596b2b1-6e59-45b3-a34a-35fe7ed2a75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:39.394649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596b2b1-6e59-45b3-a34a-35fe7ed2a75c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:39.437111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 773/1543] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:39.442880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:39.462069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9502c-636b-40bb-961e-c3edaefd07ce admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:39.558230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4e4b-974b-4bd7-bdc4-a0ae801816d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:39.559347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4e4b-974b-4bd7-bdc4-a0ae801816d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.559811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4e4b-974b-4bd7-bdc4-a0ae801816d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.560258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4e4b-974b-4bd7-bdc4-a0ae801816d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.561147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d4e4b-974b-4bd7-bdc4-a0ae801816d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:39.563338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d4e4b-974b-4bd7-bdc4-a0ae801816d6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:39.597494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 771/1544] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:39.604080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596b2b1-6e59-45b3-a34a-35fe7ed2a75c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:39.618368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596b2b1-6e59-45b3-a34a-35fe7ed2a75c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:39.627984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e61f-aa88-40a9-a394-3d897817538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:39.628918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e61f-aa88-40a9-a394-3d897817538e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.629308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e61f-aa88-40a9-a394-3d897817538e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.629749 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e61f-aa88-40a9-a394-3d897817538e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.630615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918e61f-aa88-40a9-a394-3d897817538e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:39.632566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918e61f-aa88-40a9-a394-3d897817538e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:39.651468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 774/1545] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:39.655769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4e4b-974b-4bd7-bdc4-a0ae801816d6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:39.676177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4e4b-974b-4bd7-bdc4-a0ae801816d6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:39.685738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c6a58-24c8-4700-a295-abf4e9c58a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:39.686717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c6a58-24c8-4700-a295-abf4e9c58a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.687173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c6a58-24c8-4700-a295-abf4e9c58a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.687639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c6a58-24c8-4700-a295-abf4e9c58a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.688548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c6a58-24c8-4700-a295-abf4e9c58a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:39.690669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c6a58-24c8-4700-a295-abf4e9c58a31 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:39.711847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 772/1546] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:39.717832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e61f-aa88-40a9-a394-3d897817538e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:39.732949 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e61f-aa88-40a9-a394-3d897817538e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:39.742635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd9b9-b4d5-4a78-8270-41d27f9e5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:39.744714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd9b9-b4d5-4a78-8270-41d27f9e5992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.745222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd9b9-b4d5-4a78-8270-41d27f9e5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.745632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd9b9-b4d5-4a78-8270-41d27f9e5992 admin admin] PATH_INFO: `/v3/projects/01df0d2de51e466f86ba6b8736b4b32e/users/b17c2e04df574107958a6c067957b44e/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.753569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d70cf5-399b-45fd-9ec9-bb5ce5406f33 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.754182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d70cf5-399b-45fd-9ec9-bb5ce5406f33 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.754843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d70cf5-399b-45fd-9ec9-bb5ce5406f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.767577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd9b9-b4d5-4a78-8270-41d27f9e5992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01df0d2de51e466f86ba6b8736b4b32e, user_id=b17c2e04df574107958a6c067957b44e, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:39.771853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd9b9-b4d5-4a78-8270-41d27f9e5992 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:39.788043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-15d70cf5-399b-45fd-9ec9-bb5ce5406f33 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:39.790212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15d70cf5-399b-45fd-9ec9-bb5ce5406f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:39.800061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 775/1547] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:39 2022] PUT /identity/v3/projects/01df0d2de51e466f86ba6b8736b4b32e/users/b17c2e04df574107958a6c067957b44e/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:39.801257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87271-15fb-449f-9b92-5dbd2dfd4bf9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.801664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87271-15fb-449f-9b92-5dbd2dfd4bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.802030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87271-15fb-449f-9b92-5dbd2dfd4bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.833689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-44b87271-15fb-449f-9b92-5dbd2dfd4bf9 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:39.838050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-44b87271-15fb-449f-9b92-5dbd2dfd4bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:39.928788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 773/1548] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 08 12:59:39.930300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91a99f-18bc-4b9b-af37-4e0d00670e81 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.930673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91a99f-18bc-4b9b-af37-4e0d00670e81 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.930884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91a99f-18bc-4b9b-af37-4e0d00670e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.943834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 776/1549] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:39.945416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04675b66-c593-45d6-8d1e-7860816c81c3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.945814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04675b66-c593-45d6-8d1e-7860816c81c3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.950226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04675b66-c593-45d6-8d1e-7860816c81c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.962965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ec91a99f-18bc-4b9b-af37-4e0d00670e81 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:39.963894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ec91a99f-18bc-4b9b-af37-4e0d00670e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:39.974207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 774/1550] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:39.975486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede205-713c-46bd-bf1d-736a21b9d976 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:39.976033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede205-713c-46bd-bf1d-736a21b9d976 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:39.976317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede205-713c-46bd-bf1d-736a21b9d976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:39.983007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-04675b66-c593-45d6-8d1e-7860816c81c3 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:39.984831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-04675b66-c593-45d6-8d1e-7860816c81c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:39.996696 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d6ede205-713c-46bd-bf1d-736a21b9d976 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:39.998015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d6ede205-713c-46bd-bf1d-736a21b9d976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:39.998351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 777/1551] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.001588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1aaa8-a436-42f5-88cc-ffcdcf2a616c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.002203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1aaa8-a436-42f5-88cc-ffcdcf2a616c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.002653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1aaa8-a436-42f5-88cc-ffcdcf2a616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.015384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 775/1552] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.017051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4e00-3420-4fff-be76-e637d2d5b98c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.017688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4e00-3420-4fff-be76-e637d2d5b98c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.018071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4e00-3420-4fff-be76-e637d2d5b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.029027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2fd1aaa8-a436-42f5-88cc-ffcdcf2a616c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.030577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2fd1aaa8-a436-42f5-88cc-ffcdcf2a616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.040509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 778/1553] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.048484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9b4e4e00-3420-4fff-be76-e637d2d5b98c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.048484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9b4e4e00-3420-4fff-be76-e637d2d5b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.050113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627c80-8176-4fe3-a910-3fa1ca2f5fef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.050584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627c80-8176-4fe3-a910-3fa1ca2f5fef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.051033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627c80-8176-4fe3-a910-3fa1ca2f5fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.057570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 776/1554] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.058555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4e00-3420-4fff-be76-e637d2d5b98c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.074513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a0627c80-8176-4fe3-a910-3fa1ca2f5fef None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.075728 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a0627c80-8176-4fe3-a910-3fa1ca2f5fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.085989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 779/1555] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.085989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0470-71ba-48c9-ab78-a573876800c0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.085989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0470-71ba-48c9-ab78-a573876800c0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.085989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0470-71ba-48c9-ab78-a573876800c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.104698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2c5e0470-71ba-48c9-ab78-a573876800c0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.106020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2c5e0470-71ba-48c9-ab78-a573876800c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.110526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:40.115168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 780/1556] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.116881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5b5d-de41-49e3-94b7-b27818da6079 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.117511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5b5d-de41-49e3-94b7-b27818da6079 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.117995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5b5d-de41-49e3-94b7-b27818da6079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.124924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4e00-3420-4fff-be76-e637d2d5b98c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.128639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183d290-bc77-488d-ae23-8806cde0860f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.129293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d290-bc77-488d-ae23-8806cde0860f service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.129651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d290-bc77-488d-ae23-8806cde0860f service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.129983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d290-bc77-488d-ae23-8806cde0860f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.138833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b8ee5b5d-de41-49e3-94b7-b27818da6079 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.140391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183d290-bc77-488d-ae23-8806cde0860f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.141093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b8ee5b5d-de41-49e3-94b7-b27818da6079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.141897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183d290-bc77-488d-ae23-8806cde0860f service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.152830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 777/1557] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:40.152998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 781/1558] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.154052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9bfd2-89fd-4042-8e82-1a1031dec7c5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.154342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9bfd2-89fd-4042-8e82-1a1031dec7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.154620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9bfd2-89fd-4042-8e82-1a1031dec7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.155658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793c0a-423f-4ee8-84db-1fe07714159e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.156222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793c0a-423f-4ee8-84db-1fe07714159e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.156718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793c0a-423f-4ee8-84db-1fe07714159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.178400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-25d9bfd2-89fd-4042-8e82-1a1031dec7c5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.179645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-25d9bfd2-89fd-4042-8e82-1a1031dec7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.183493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fe793c0a-423f-4ee8-84db-1fe07714159e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.184863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe793c0a-423f-4ee8-84db-1fe07714159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.188523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 778/1559] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.191095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9bfd2-89fd-4042-8e82-1a1031dec7c5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.194342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 782/1560] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.195886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe793c0a-423f-4ee8-84db-1fe07714159e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.210729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe793c0a-423f-4ee8-84db-1fe07714159e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.210945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9bfd2-89fd-4042-8e82-1a1031dec7c5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.216738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.216908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670dfe-6e5f-4172-a077-711fbf9d6b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.217428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.217624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670dfe-6e5f-4172-a077-711fbf9d6b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.217823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.217934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670dfe-6e5f-4172-a077-711fbf9d6b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.218040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.218139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670dfe-6e5f-4172-a077-711fbf9d6b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.218791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:40.218915 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670dfe-6e5f-4172-a077-711fbf9d6b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:40.219112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.219256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670dfe-6e5f-4172-a077-711fbf9d6b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.220155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING py.warnings [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:59:40.220155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: warnings.warn(msg) Jun 08 12:59:40.220155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: Jun 08 12:59:40.220742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670dfe-6e5f-4172-a077-711fbf9d6b5a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.221047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.235066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 779/1561] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:40.235345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 783/1562] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:40.235955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.239402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6643-5c18-46a2-b91b-d0a35bafdba7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.240382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6643-5c18-46a2-b91b-d0a35bafdba7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.241094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6643-5c18-46a2-b91b-d0a35bafdba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.247510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b683aa9-1af8-4782-abdf-f7863f58ac0b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.253353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.254027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.254634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.254634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.255458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:40.256091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.257486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.266280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-463f6643-5c18-46a2-b91b-d0a35bafdba7 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.268077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-463f6643-5c18-46a2-b91b-d0a35bafdba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.271820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 784/1563] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:40.272605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.280684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 780/1564] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.281948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6643-5c18-46a2-b91b-d0a35bafdba7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.289119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86dedf-d140-4151-a094-dc1c99fa5246 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.293570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6643-5c18-46a2-b91b-d0a35bafdba7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.294440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce67dc4-81b6-471b-805d-03cfa76ca04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.295153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce67dc4-81b6-471b-805d-03cfa76ca04a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.295595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce67dc4-81b6-471b-805d-03cfa76ca04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.295894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce67dc4-81b6-471b-805d-03cfa76ca04a admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.296630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce67dc4-81b6-471b-805d-03cfa76ca04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:40.297031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce67dc4-81b6-471b-805d-03cfa76ca04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.298755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce67dc4-81b6-471b-805d-03cfa76ca04a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.299333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.300013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.300290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.300596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.301300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:40.301637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.303239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.315375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 785/1565] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:40.316957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b8e4c-d52f-49f7-a59d-30c367817cce None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.317327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b8e4c-d52f-49f7-a59d-30c367817cce None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.317701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b8e4c-d52f-49f7-a59d-30c367817cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.318356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 781/1566] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:40.319167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.329871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc926e53-f10f-4e64-afa7-57d14c85df95 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.335631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.336421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.336708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.336987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.338462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.340148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:59:40.340148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jun 08 12:59:40.340148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: Jun 08 12:59:40.341877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.343660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1d2b8e4c-d52f-49f7-a59d-30c367817cce None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.344885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1d2b8e4c-d52f-49f7-a59d-30c367817cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.356846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 786/1567] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.360852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b8e4c-d52f-49f7-a59d-30c367817cce None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.371913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b8e4c-d52f-49f7-a59d-30c367817cce None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.382110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 782/1568] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.382110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.387826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c0d23-3e1d-4cac-8f97-dbd6ce83323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.388512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0d23-3e1d-4cac-8f97-dbd6ce83323c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.388801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0d23-3e1d-4cac-8f97-dbd6ce83323c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.389086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0d23-3e1d-4cac-8f97-dbd6ce83323c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.389864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c0d23-3e1d-4cac-8f97-dbd6ce83323c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.392868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c0d23-3e1d-4cac-8f97-dbd6ce83323c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.406003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:40.434385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 787/1569] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.435715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ec80-5951-437f-b846-cf288e01daa4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.436016 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ec80-5951-437f-b846-cf288e01daa4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.437114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ec80-5951-437f-b846-cf288e01daa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.456909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2249ec80-5951-437f-b846-cf288e01daa4 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:40.458187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2249ec80-5951-437f-b846-cf288e01daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:40.473203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf494-fe6a-45b0-8ea3-0af57ff57717 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.554809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 788/1570] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:40.555861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ec80-5951-437f-b846-cf288e01daa4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.559851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690150f3-b09b-4c23-a885-8e7e60649d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.560594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690150f3-b09b-4c23-a885-8e7e60649d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.560888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690150f3-b09b-4c23-a885-8e7e60649d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.561174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690150f3-b09b-4c23-a885-8e7e60649d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.562139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690150f3-b09b-4c23-a885-8e7e60649d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.564254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690150f3-b09b-4c23-a885-8e7e60649d31 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.568143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ec80-5951-437f-b846-cf288e01daa4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.573760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e48891-1cc8-426a-87f4-39baaf25c0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.574932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48891-1cc8-426a-87f4-39baaf25c0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.575229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48891-1cc8-426a-87f4-39baaf25c0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.575518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48891-1cc8-426a-87f4-39baaf25c0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.576227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e48891-1cc8-426a-87f4-39baaf25c0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.578620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e48891-1cc8-426a-87f4-39baaf25c0f5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.602524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 783/1571] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.604080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690150f3-b09b-4c23-a885-8e7e60649d31 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.613594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 789/1572] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.613594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e48891-1cc8-426a-87f4-39baaf25c0f5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.622222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:40.694617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e48891-1cc8-426a-87f4-39baaf25c0f5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.696484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690150f3-b09b-4c23-a885-8e7e60649d31 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.700305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.700990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.701286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.701596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.702342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:40.702452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236eab-f424-4f4c-90d5-6df4806ce02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.702794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.703138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236eab-f424-4f4c-90d5-6df4806ce02a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.703430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236eab-f424-4f4c-90d5-6df4806ce02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.703716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236eab-f424-4f4c-90d5-6df4806ce02a admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.704475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.704604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e236eab-f424-4f4c-90d5-6df4806ce02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.706680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e236eab-f424-4f4c-90d5-6df4806ce02a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.718506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 790/1573] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:40.719280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.731594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cce89c-b028-41e6-b9fa-a74d20d36335 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.738178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 784/1574] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.739079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236eab-f424-4f4c-90d5-6df4806ce02a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.744859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.745765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.746058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.746382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.747130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.748228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING py.warnings [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:59:40.748228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: warnings.warn(msg) Jun 08 12:59:40.748228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: Jun 08 12:59:40.749694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.780000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 791/1575] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/users => generated 293 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.780000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.791952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3c133-73a9-4549-b9a6-55d66545a5a7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.819702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236eab-f424-4f4c-90d5-6df4806ce02a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.826321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235eb57-c1ce-458d-abd0-4f672580c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.827369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235eb57-c1ce-458d-abd0-4f672580c62b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.827740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235eb57-c1ce-458d-abd0-4f672580c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.828106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235eb57-c1ce-458d-abd0-4f672580c62b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.828890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235eb57-c1ce-458d-abd0-4f672580c62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.830903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235eb57-c1ce-458d-abd0-4f672580c62b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.840921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:40.865330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 785/1576] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.865330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235eb57-c1ce-458d-abd0-4f672580c62b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.868768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.869658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.869964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.870370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.873183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:40.873183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.873183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.880112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235eb57-c1ce-458d-abd0-4f672580c62b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.887827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc8fa-213f-4cd0-b697-9156a614b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.889089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc8fa-213f-4cd0-b697-9156a614b281 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.889390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc8fa-213f-4cd0-b697-9156a614b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.889710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc8fa-213f-4cd0-b697-9156a614b281 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.890580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc8fa-213f-4cd0-b697-9156a614b281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.899090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 792/1577] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:40.899269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc8fa-213f-4cd0-b697-9156a614b281 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.899364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.906906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb597d-d445-49d2-ab26-2daf4a4cd284 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.914466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5a16c-e809-4d35-99bd-49b9f4918106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.915194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5a16c-e809-4d35-99bd-49b9f4918106 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.915631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5a16c-e809-4d35-99bd-49b9f4918106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.915982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5a16c-e809-4d35-99bd-49b9f4918106 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.916830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5a16c-e809-4d35-99bd-49b9f4918106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.919157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5a16c-e809-4d35-99bd-49b9f4918106 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.924507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 786/1578] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/users => generated 294 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.925634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc8fa-213f-4cd0-b697-9156a614b281 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.942898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc8fa-213f-4cd0-b697-9156a614b281 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.945875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 793/1579] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.950388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5a16c-e809-4d35-99bd-49b9f4918106 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:40.951887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541bd2-e783-4a2a-ac89-6a280c5c00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.952578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541bd2-e783-4a2a-ac89-6a280c5c00e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.952869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541bd2-e783-4a2a-ac89-6a280c5c00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.953883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541bd2-e783-4a2a-ac89-6a280c5c00e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.954604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45541bd2-e783-4a2a-ac89-6a280c5c00e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.956542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45541bd2-e783-4a2a-ac89-6a280c5c00e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.963507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5a16c-e809-4d35-99bd-49b9f4918106 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:40.982298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74e879-2a5b-4f34-aa3b-421e98a28b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:40.982298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e879-2a5b-4f34-aa3b-421e98a28b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:40.982298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e879-2a5b-4f34-aa3b-421e98a28b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:40.982298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e879-2a5b-4f34-aa3b-421e98a28b38 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:40.982921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74e879-2a5b-4f34-aa3b-421e98a28b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:40.982921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74e879-2a5b-4f34-aa3b-421e98a28b38 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:40.998706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 794/1580] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:40.999817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74e879-2a5b-4f34-aa3b-421e98a28b38 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.008749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 787/1581] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:40 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:41.010204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541bd2-e783-4a2a-ac89-6a280c5c00e3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.012966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74e879-2a5b-4f34-aa3b-421e98a28b38 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.072505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:41.087979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b419-5a17-4fb3-843f-ff5fd947c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.088680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b419-5a17-4fb3-843f-ff5fd947c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.088941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541bd2-e783-4a2a-ac89-6a280c5c00e3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.089071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b419-5a17-4fb3-843f-ff5fd947c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.089234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b419-5a17-4fb3-843f-ff5fd947c7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.090010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1b419-5a17-4fb3-843f-ff5fd947c7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.091802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1b419-5a17-4fb3-843f-ff5fd947c7d3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.094235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12daf-1d6d-4b44-bdc5-5b3e7fa1440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.094979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12daf-1d6d-4b44-bdc5-5b3e7fa1440a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.095360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12daf-1d6d-4b44-bdc5-5b3e7fa1440a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.095719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12daf-1d6d-4b44-bdc5-5b3e7fa1440a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.096671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea12daf-1d6d-4b44-bdc5-5b3e7fa1440a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.098510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea12daf-1d6d-4b44-bdc5-5b3e7fa1440a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.102592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 795/1582] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.103563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b419-5a17-4fb3-843f-ff5fd947c7d3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.115991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 788/1583] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.116185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b419-5a17-4fb3-843f-ff5fd947c7d3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.116270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12daf-1d6d-4b44-bdc5-5b3e7fa1440a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.123209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8d297-86ee-4aa6-bf0c-4b4360ea0018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.123892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d297-86ee-4aa6-bf0c-4b4360ea0018 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.124179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d297-86ee-4aa6-bf0c-4b4360ea0018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.124460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d297-86ee-4aa6-bf0c-4b4360ea0018 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.125593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8d297-86ee-4aa6-bf0c-4b4360ea0018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.125805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12daf-1d6d-4b44-bdc5-5b3e7fa1440a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.127321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8d297-86ee-4aa6-bf0c-4b4360ea0018 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.131029 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e5e0-b8ac-417d-a3b5-3852bba686c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.132013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e5e0-b8ac-417d-a3b5-3852bba686c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.132519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e5e0-b8ac-417d-a3b5-3852bba686c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.132950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e5e0-b8ac-417d-a3b5-3852bba686c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.133642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8e5e0-b8ac-417d-a3b5-3852bba686c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.135947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8e5e0-b8ac-417d-a3b5-3852bba686c3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.148889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 789/1584] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.149652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e5e0-b8ac-417d-a3b5-3852bba686c3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.164460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e5e0-b8ac-417d-a3b5-3852bba686c3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.171036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 796/1585] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:41.171036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb374a51-626a-4fbe-b403-607676229a2f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.171036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb374a51-626a-4fbe-b403-607676229a2f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.171036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb374a51-626a-4fbe-b403-607676229a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.171476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c5bcc-1ad1-43cc-b476-635267683c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.171476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c5bcc-1ad1-43cc-b476-635267683c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.171903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c5bcc-1ad1-43cc-b476-635267683c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.172290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c5bcc-1ad1-43cc-b476-635267683c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.173100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c5bcc-1ad1-43cc-b476-635267683c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.174922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c5bcc-1ad1-43cc-b476-635267683c37 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.191879 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 790/1586] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.192726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c5bcc-1ad1-43cc-b476-635267683c37 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.199040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fb374a51-626a-4fbe-b403-607676229a2f None None] MFA Rules not processed for user `b17c2e04df574107958a6c067957b44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:41.200334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fb374a51-626a-4fbe-b403-607676229a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:41.202832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c5bcc-1ad1-43cc-b476-635267683c37 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.261466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50533-0db8-4024-8081-e8ea863cf928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.262182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50533-0db8-4024-8081-e8ea863cf928 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.262471 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50533-0db8-4024-8081-e8ea863cf928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.262756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50533-0db8-4024-8081-e8ea863cf928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.263525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c50533-0db8-4024-8081-e8ea863cf928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.265312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c50533-0db8-4024-8081-e8ea863cf928 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.271962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 797/1587] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:41.272885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb374a51-626a-4fbe-b403-607676229a2f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.286649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 791/1588] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.286649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50533-0db8-4024-8081-e8ea863cf928 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.289849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb374a51-626a-4fbe-b403-607676229a2f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.295089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045fd26-59ba-4be6-bcc5-0ffb6f39e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.295577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50533-0db8-4024-8081-e8ea863cf928 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.295783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045fd26-59ba-4be6-bcc5-0ffb6f39e80c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.296076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045fd26-59ba-4be6-bcc5-0ffb6f39e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.296361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045fd26-59ba-4be6-bcc5-0ffb6f39e80c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.297061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045fd26-59ba-4be6-bcc5-0ffb6f39e80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.299048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045fd26-59ba-4be6-bcc5-0ffb6f39e80c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.300173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e1a2-da63-4042-8a94-9eb5cab2c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.300829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e1a2-da63-4042-8a94-9eb5cab2c079 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.301120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e1a2-da63-4042-8a94-9eb5cab2c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.301402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e1a2-da63-4042-8a94-9eb5cab2c079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.302162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50e1a2-da63-4042-8a94-9eb5cab2c079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.303836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50e1a2-da63-4042-8a94-9eb5cab2c079 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.306502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:41.316076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 792/1589] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.316902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e1a2-da63-4042-8a94-9eb5cab2c079 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.322630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 798/1590] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/users => generated 291 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:41.323659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045fd26-59ba-4be6-bcc5-0ffb6f39e80c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.330419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e1a2-da63-4042-8a94-9eb5cab2c079 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.335095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e940d-601a-4e0d-b109-9f09456b2913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.335270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045fd26-59ba-4be6-bcc5-0ffb6f39e80c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.335764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e940d-601a-4e0d-b109-9f09456b2913 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.336053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e940d-601a-4e0d-b109-9f09456b2913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.336332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e940d-601a-4e0d-b109-9f09456b2913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.337068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e940d-601a-4e0d-b109-9f09456b2913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.339627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e940d-601a-4e0d-b109-9f09456b2913 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.340468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647029ae-77f0-4cc0-87d4-4f1cdb67949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.341144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647029ae-77f0-4cc0-87d4-4f1cdb67949f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.341435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647029ae-77f0-4cc0-87d4-4f1cdb67949f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.341772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647029ae-77f0-4cc0-87d4-4f1cdb67949f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.342510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647029ae-77f0-4cc0-87d4-4f1cdb67949f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.344147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647029ae-77f0-4cc0-87d4-4f1cdb67949f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.350637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 793/1591] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.351516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e940d-601a-4e0d-b109-9f09456b2913 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.359586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 799/1592] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.359586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647029ae-77f0-4cc0-87d4-4f1cdb67949f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.364017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e940d-601a-4e0d-b109-9f09456b2913 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.367119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647029ae-77f0-4cc0-87d4-4f1cdb67949f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.368968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6fe72-11c7-4b9c-8dcb-fcb07dd41787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.369682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fe72-11c7-4b9c-8dcb-fcb07dd41787 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.370057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fe72-11c7-4b9c-8dcb-fcb07dd41787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.370382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fe72-11c7-4b9c-8dcb-fcb07dd41787 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.371077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6fe72-11c7-4b9c-8dcb-fcb07dd41787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.372095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb7a44-2d56-4393-bd80-5b7723fb5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.372767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7a44-2d56-4393-bd80-5b7723fb5e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.373009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6fe72-11c7-4b9c-8dcb-fcb07dd41787 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.373117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7a44-2d56-4393-bd80-5b7723fb5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.373328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7a44-2d56-4393-bd80-5b7723fb5e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.374160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb7a44-2d56-4393-bd80-5b7723fb5e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.375713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb7a44-2d56-4393-bd80-5b7723fb5e78 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.387175 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 800/1593] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.388422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d227b1-9249-478a-8ceb-d0e39ac64695 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.388776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d227b1-9249-478a-8ceb-d0e39ac64695 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.389062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d227b1-9249-478a-8ceb-d0e39ac64695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.396718 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 794/1594] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:41.397573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6fe72-11c7-4b9c-8dcb-fcb07dd41787 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.408267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6fe72-11c7-4b9c-8dcb-fcb07dd41787 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.413034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082860ab-749b-4944-b0e3-190edc893897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.413706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-34d227b1-9249-478a-8ceb-d0e39ac64695 None None] MFA Rules not processed for user `b17c2e04df574107958a6c067957b44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:41.413858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082860ab-749b-4944-b0e3-190edc893897 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.414021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082860ab-749b-4944-b0e3-190edc893897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.414305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082860ab-749b-4944-b0e3-190edc893897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.414952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-34d227b1-9249-478a-8ceb-d0e39ac64695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:41.415076 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082860ab-749b-4944-b0e3-190edc893897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.417345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082860ab-749b-4944-b0e3-190edc893897 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.422333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 801/1595] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:41.423154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d227b1-9249-478a-8ceb-d0e39ac64695 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.428650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 795/1596] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.430354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082860ab-749b-4944-b0e3-190edc893897 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.442174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082860ab-749b-4944-b0e3-190edc893897 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.442645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d227b1-9249-478a-8ceb-d0e39ac64695 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.448593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95150b3e-2b7b-46c8-ae58-985a213bc8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.449275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150b3e-2b7b-46c8-ae58-985a213bc8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.449736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150b3e-2b7b-46c8-ae58-985a213bc8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.450024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150b3e-2b7b-46c8-ae58-985a213bc8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.450499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d88bc-3d46-4673-89aa-e1deaa06b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.450846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95150b3e-2b7b-46c8-ae58-985a213bc8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.452063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d88bc-3d46-4673-89aa-e1deaa06b785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.452365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95150b3e-2b7b-46c8-ae58-985a213bc8e1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.452731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d88bc-3d46-4673-89aa-e1deaa06b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.453367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d88bc-3d46-4673-89aa-e1deaa06b785 admin admin] PATH_INFO: `/v3/projects/f22687437aee4dacb1be127cbcf4209f/users/dcd4aeea3a094122a7c7c6944b96cb71/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.465573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 796/1597] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.469346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95150b3e-2b7b-46c8-ae58-985a213bc8e1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.472770 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d88bc-3d46-4673-89aa-e1deaa06b785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22687437aee4dacb1be127cbcf4209f, user_id=dcd4aeea3a094122a7c7c6944b96cb71, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.475501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d88bc-3d46-4673-89aa-e1deaa06b785 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.476792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95150b3e-2b7b-46c8-ae58-985a213bc8e1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.487053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.488073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.488366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.488657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] PATH_INFO: `/v3/projects/74742afebd7540fe9f3c2c23953eb6a7/users/80ffae178b294666b137bf69233eef46/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.495433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 802/1598] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:41 2022] PUT /identity/v3/projects/f22687437aee4dacb1be127cbcf4209f/users/dcd4aeea3a094122a7c7c6944b96cb71/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:41.498468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d88bc-3d46-4673-89aa-e1deaa06b785 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.507445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74742afebd7540fe9f3c2c23953eb6a7, user_id=80ffae178b294666b137bf69233eef46, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.508600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:59:41.508600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jun 08 12:59:41.508600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: Jun 08 12:59:41.510561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.524759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 797/1599] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:41 2022] PUT /identity/v3/projects/74742afebd7540fe9f3c2c23953eb6a7/users/80ffae178b294666b137bf69233eef46/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:41.526133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.564362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d88bc-3d46-4673-89aa-e1deaa06b785 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.564747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:41.594592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32d082-11ed-4d04-a3be-4a4504874391 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.599427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab7d57-ce22-4f05-a081-dee6df4e6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.600341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab7d57-ce22-4f05-a081-dee6df4e6540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.600628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab7d57-ce22-4f05-a081-dee6df4e6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.600914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab7d57-ce22-4f05-a081-dee6df4e6540 admin admin] PATH_INFO: `/v3/projects/2d72d1cf271f460e80d13a6678c36d71/users/2a550d483fee4f84a11dccf72fc85dd6/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.616563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab7d57-ce22-4f05-a081-dee6df4e6540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d72d1cf271f460e80d13a6678c36d71, user_id=2a550d483fee4f84a11dccf72fc85dd6, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.620269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab7d57-ce22-4f05-a081-dee6df4e6540 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.624953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c730762-baee-493f-bdc3-5ae78e6c53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.626001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730762-baee-493f-bdc3-5ae78e6c53df admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.626345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730762-baee-493f-bdc3-5ae78e6c53df admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.626702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730762-baee-493f-bdc3-5ae78e6c53df admin admin] PATH_INFO: `/v3/projects/eac6e31ac0884ca596746bb1ccdffdc0/users/8986cbf0b3534177a6436113896b161d/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.634233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 798/1600] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:41 2022] PUT /identity/v3/projects/2d72d1cf271f460e80d13a6678c36d71/users/2a550d483fee4f84a11dccf72fc85dd6/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:41.636716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab7d57-ce22-4f05-a081-dee6df4e6540 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.645113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c730762-baee-493f-bdc3-5ae78e6c53df admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac6e31ac0884ca596746bb1ccdffdc0, user_id=8986cbf0b3534177a6436113896b161d, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.647969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c730762-baee-493f-bdc3-5ae78e6c53df admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.668425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 803/1601] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:41 2022] PUT /identity/v3/projects/eac6e31ac0884ca596746bb1ccdffdc0/users/8986cbf0b3534177a6436113896b161d/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:41.668425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c730762-baee-493f-bdc3-5ae78e6c53df admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.701263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:41.701507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab7d57-ce22-4f05-a081-dee6df4e6540 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.735754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c730762-baee-493f-bdc3-5ae78e6c53df admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.740490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c154-b0b5-4350-b471-b7c83b5ed75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.741388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c154-b0b5-4350-b471-b7c83b5ed75b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.741706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c154-b0b5-4350-b471-b7c83b5ed75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.741994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c154-b0b5-4350-b471-b7c83b5ed75b admin admin] PATH_INFO: `/v3/projects/e45a1593b33a44b89b3d88ce463084fb/users/9150082f9a3742f1a54c55930283ca03/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.757835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2c154-b0b5-4350-b471-b7c83b5ed75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45a1593b33a44b89b3d88ce463084fb, user_id=9150082f9a3742f1a54c55930283ca03, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.760341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d295b96-5369-4042-bcd2-f2bbb0514cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.760874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2c154-b0b5-4350-b471-b7c83b5ed75b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.761024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d295b96-5369-4042-bcd2-f2bbb0514cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.761331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d295b96-5369-4042-bcd2-f2bbb0514cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.761630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d295b96-5369-4042-bcd2-f2bbb0514cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.762390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d295b96-5369-4042-bcd2-f2bbb0514cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.764019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d295b96-5369-4042-bcd2-f2bbb0514cd7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.776190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 804/1602] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:41 2022] PUT /identity/v3/projects/e45a1593b33a44b89b3d88ce463084fb/users/9150082f9a3742f1a54c55930283ca03/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:41.779813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 799/1603] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.779813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d295b96-5369-4042-bcd2-f2bbb0514cd7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.781323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc7e8-eb47-479e-b660-0bf90e31f6b1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.781870 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc7e8-eb47-479e-b660-0bf90e31f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.782111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc7e8-eb47-479e-b660-0bf90e31f6b1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.784561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 805/1604] 10.222.0.46 () {54 vars in 961 bytes} [Wed Jun 8 12:59:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:59:41.785927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36041a62-81d3-49c5-9a72-8e9083916331 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.786304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36041a62-81d3-49c5-9a72-8e9083916331 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.786887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36041a62-81d3-49c5-9a72-8e9083916331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.800271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d295b96-5369-4042-bcd2-f2bbb0514cd7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.809464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-36041a62-81d3-49c5-9a72-8e9083916331 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:41.810710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-36041a62-81d3-49c5-9a72-8e9083916331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:41.858752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b7415-e8e7-4f4f-b77d-c70702f8f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.859632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7415-e8e7-4f4f-b77d-c70702f8f012 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.859917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7415-e8e7-4f4f-b77d-c70702f8f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.860194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7415-e8e7-4f4f-b77d-c70702f8f012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.860927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b7415-e8e7-4f4f-b77d-c70702f8f012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.862599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b7415-e8e7-4f4f-b77d-c70702f8f012 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.865206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:41.878318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 800/1605] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.878318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2317e-cf23-498b-a41e-061d10f0a462 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.878318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2317e-cf23-498b-a41e-061d10f0a462 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.878318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2317e-cf23-498b-a41e-061d10f0a462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.886452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 806/1606] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:41.886452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b7750-7401-4b11-b864-559fce438eac None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.886452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b7750-7401-4b11-b864-559fce438eac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.886452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b7750-7401-4b11-b864-559fce438eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.898319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-40a2317e-cf23-498b-a41e-061d10f0a462 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:41.899600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-40a2317e-cf23-498b-a41e-061d10f0a462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:41.905843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b22b7750-7401-4b11-b864-559fce438eac None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:41.907032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b22b7750-7401-4b11-b864-559fce438eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:41.910490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 801/1607] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:41.911730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c79b-63ed-43ba-a44c-80406926d236 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.912027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c79b-63ed-43ba-a44c-80406926d236 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.912309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c79b-63ed-43ba-a44c-80406926d236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.918563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 807/1608] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:41.922366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b7750-7401-4b11-b864-559fce438eac None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:41.931930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b7750-7401-4b11-b864-559fce438eac None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:41.937205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25833385-508a-49d4-91d2-c9319a6e58dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:41.937835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-83e7c79b-63ed-43ba-a44c-80406926d236 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:41.937972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833385-508a-49d4-91d2-c9319a6e58dd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.938210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833385-508a-49d4-91d2-c9319a6e58dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.938485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833385-508a-49d4-91d2-c9319a6e58dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.939099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-83e7c79b-63ed-43ba-a44c-80406926d236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:41.939217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25833385-508a-49d4-91d2-c9319a6e58dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:41.940825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25833385-508a-49d4-91d2-c9319a6e58dd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:41.947008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 802/1609] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:41.948574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d8a1-49e6-4b8f-907e-11c6c88f1b40 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.948870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d8a1-49e6-4b8f-907e-11c6c88f1b40 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.949152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d8a1-49e6-4b8f-907e-11c6c88f1b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.953997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 808/1610] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:41.955491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35d9e8-6707-4f3d-ab51-d1038398dcf7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:41.955797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35d9e8-6707-4f3d-ab51-d1038398dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:41.956115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35d9e8-6707-4f3d-ab51-d1038398dcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:41.974982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5a35d9e8-6707-4f3d-ab51-d1038398dcf7 None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:41.976853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5a35d9e8-6707-4f3d-ab51-d1038398dcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:41.979209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-10c8d8a1-49e6-4b8f-907e-11c6c88f1b40 None None] MFA Rules not processed for user `9150082f9a3742f1a54c55930283ca03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:41.980607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-10c8d8a1-49e6-4b8f-907e-11c6c88f1b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:42.047164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 809/1611] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:42.048090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35d9e8-6707-4f3d-ab51-d1038398dcf7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.048691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 803/1612] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:42.049566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8d8a1-49e6-4b8f-907e-11c6c88f1b40 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.060034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35d9e8-6707-4f3d-ab51-d1038398dcf7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.066099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981fab-8a89-4a45-b9fc-45ddbea53cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.067011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981fab-8a89-4a45-b9fc-45ddbea53cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.067295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981fab-8a89-4a45-b9fc-45ddbea53cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.067572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981fab-8a89-4a45-b9fc-45ddbea53cc5 admin admin] PATH_INFO: `/v3/projects/796d808da3574f12ac77e1c9e31ec420/users/a3331ce8e39c4ec2ab1367f9d88441e1/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.087827 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e981fab-8a89-4a45-b9fc-45ddbea53cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796d808da3574f12ac77e1c9e31ec420, user_id=a3331ce8e39c4ec2ab1367f9d88441e1, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.091091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e981fab-8a89-4a45-b9fc-45ddbea53cc5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.101398 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:42.107635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 810/1613] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:42 2022] PUT /identity/v3/projects/796d808da3574f12ac77e1c9e31ec420/users/a3331ce8e39c4ec2ab1367f9d88441e1/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:42.110778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981fab-8a89-4a45-b9fc-45ddbea53cc5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.126608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8d8a1-49e6-4b8f-907e-11c6c88f1b40 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.176778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981fab-8a89-4a45-b9fc-45ddbea53cc5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.180519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89fd05-82dd-49b3-8012-05e0e512c340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.181721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89fd05-82dd-49b3-8012-05e0e512c340 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.182026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89fd05-82dd-49b3-8012-05e0e512c340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.182311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89fd05-82dd-49b3-8012-05e0e512c340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.183060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850067f-53c4-452d-b42d-80f9629540e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.183724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850067f-53c4-452d-b42d-80f9629540e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.184017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850067f-53c4-452d-b42d-80f9629540e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.184310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850067f-53c4-452d-b42d-80f9629540e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.232556 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:42.249172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89fd05-82dd-49b3-8012-05e0e512c340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.250675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89fd05-82dd-49b3-8012-05e0e512c340 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.253164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850067f-53c4-452d-b42d-80f9629540e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.254669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850067f-53c4-452d-b42d-80f9629540e5 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.260630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 811/1614] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:42.261448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89fd05-82dd-49b3-8012-05e0e512c340 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.265023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 804/1615] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:42.265805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850067f-53c4-452d-b42d-80f9629540e5 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.269713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89fd05-82dd-49b3-8012-05e0e512c340 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.273781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ca86-0aa1-4e92-bc26-fced137b37ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.274366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ca86-0aa1-4e92-bc26-fced137b37ec service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.274626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ca86-0aa1-4e92-bc26-fced137b37ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.274908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ca86-0aa1-4e92-bc26-fced137b37ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.275360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850067f-53c4-452d-b42d-80f9629540e5 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.279918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6856-468a-49a7-8655-ade604f97aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.280818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6856-468a-49a7-8655-ade604f97aee admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.281202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6856-468a-49a7-8655-ade604f97aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.281383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6856-468a-49a7-8655-ade604f97aee admin admin] PATH_INFO: `/v3/projects/6b8bbf588d644cac83a150f00795cdc0/users/594589127d3442b090d05d11b82d3eaa/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.284738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ca86-0aa1-4e92-bc26-fced137b37ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.286250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ca86-0aa1-4e92-bc26-fced137b37ec service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.297352 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 812/1616] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:42.298308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ca86-0aa1-4e92-bc26-fced137b37ec service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.307609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ca86-0aa1-4e92-bc26-fced137b37ec service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.308844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b6856-468a-49a7-8655-ade604f97aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8bbf588d644cac83a150f00795cdc0, user_id=594589127d3442b090d05d11b82d3eaa, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.312342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b6856-468a-49a7-8655-ade604f97aee admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.319602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472c029-d82a-46e9-95c1-f1524d68580f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.320573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472c029-d82a-46e9-95c1-f1524d68580f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.320830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472c029-d82a-46e9-95c1-f1524d68580f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.321077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472c029-d82a-46e9-95c1-f1524d68580f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.339016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 805/1617] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:42 2022] PUT /identity/v3/projects/6b8bbf588d644cac83a150f00795cdc0/users/594589127d3442b090d05d11b82d3eaa/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:42.339876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6856-468a-49a7-8655-ade604f97aee admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.344666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472c029-d82a-46e9-95c1-f1524d68580f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.348056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472c029-d82a-46e9-95c1-f1524d68580f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.371349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 813/1618] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:42.372814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14896b7-14ae-41e4-a597-7d62ecdba729 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.373109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14896b7-14ae-41e4-a597-7d62ecdba729 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.373396 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14896b7-14ae-41e4-a597-7d62ecdba729 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.375230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 814/1619] 10.222.0.46 () {54 vars in 961 bytes} [Wed Jun 8 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:59:42.376666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a98f8e-d5dd-4f26-94c0-67fe7ccaf24d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.376959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a98f8e-d5dd-4f26-94c0-67fe7ccaf24d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.377242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a98f8e-d5dd-4f26-94c0-67fe7ccaf24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.424194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-91a98f8e-d5dd-4f26-94c0-67fe7ccaf24d None None] MFA Rules not processed for user `a3331ce8e39c4ec2ab1367f9d88441e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:42.426475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-91a98f8e-d5dd-4f26-94c0-67fe7ccaf24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:42.473090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6856-468a-49a7-8655-ade604f97aee admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.483069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591d422-439e-4314-adea-088bf9ed949c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.484881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d422-439e-4314-adea-088bf9ed949c service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.486005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d422-439e-4314-adea-088bf9ed949c service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.486804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d422-439e-4314-adea-088bf9ed949c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.537821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 815/1620] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:42.540296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae8e3-c05e-4b27-990b-3c33ef51fb51 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.541415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae8e3-c05e-4b27-990b-3c33ef51fb51 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.541963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae8e3-c05e-4b27-990b-3c33ef51fb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.575280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:42.583124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5b9ae8e3-c05e-4b27-990b-3c33ef51fb51 None None] MFA Rules not processed for user `594589127d3442b090d05d11b82d3eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:42.584494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b9ae8e3-c05e-4b27-990b-3c33ef51fb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:42.599589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591d422-439e-4314-adea-088bf9ed949c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.602236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591d422-439e-4314-adea-088bf9ed949c service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.617741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 806/1621] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:42.620248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29467a-cbc7-4c88-8e90-14fbf86cd08b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.620687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29467a-cbc7-4c88-8e90-14fbf86cd08b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.621074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29467a-cbc7-4c88-8e90-14fbf86cd08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.644797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8d29467a-cbc7-4c88-8e90-14fbf86cd08b None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:42.646251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8d29467a-cbc7-4c88-8e90-14fbf86cd08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:42.665178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 807/1622] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Jun 8 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:42.666730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29467a-cbc7-4c88-8e90-14fbf86cd08b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.727968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 816/1623] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:42.727968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae8e3-c05e-4b27-990b-3c33ef51fb51 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.754441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae8e3-c05e-4b27-990b-3c33ef51fb51 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.796224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:42.797974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77817689-74b0-4f99-aab2-8b3347634e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.800557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817689-74b0-4f99-aab2-8b3347634e06 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.800870 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817689-74b0-4f99-aab2-8b3347634e06 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.801538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817689-74b0-4f99-aab2-8b3347634e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.841117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29467a-cbc7-4c88-8e90-14fbf86cd08b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:42.859875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903701e-4772-44b7-a36e-ce7480d287c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:42.861255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903701e-4772-44b7-a36e-ce7480d287c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:42.861255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903701e-4772-44b7-a36e-ce7480d287c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:42.861255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903701e-4772-44b7-a36e-ce7480d287c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:42.862299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903701e-4772-44b7-a36e-ce7480d287c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.865990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903701e-4772-44b7-a36e-ce7480d287c6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.932472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 808/1624] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:42 2022] POST /identity/v3/projects => generated 379 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:42.933715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903701e-4772-44b7-a36e-ce7480d287c6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.941460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77817689-74b0-4f99-aab2-8b3347634e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:42.949272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77817689-74b0-4f99-aab2-8b3347634e06 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:42.969061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 817/1625] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:42.970424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77817689-74b0-4f99-aab2-8b3347634e06 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:42.987739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77817689-74b0-4f99-aab2-8b3347634e06 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:43.075024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903701e-4772-44b7-a36e-ce7480d287c6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:43.086794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e313cbd-72f7-4a67-8722-5a01198bccee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:43.088358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313cbd-72f7-4a67-8722-5a01198bccee service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.089974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313cbd-72f7-4a67-8722-5a01198bccee service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.090443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313cbd-72f7-4a67-8722-5a01198bccee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.133241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d00ed-5c2a-4c81-8f4b-5e42345f4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:43.134921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d00ed-5c2a-4c81-8f4b-5e42345f4385 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.136035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d00ed-5c2a-4c81-8f4b-5e42345f4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.137448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d00ed-5c2a-4c81-8f4b-5e42345f4385 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.138911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d00ed-5c2a-4c81-8f4b-5e42345f4385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:43.145029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d00ed-5c2a-4c81-8f4b-5e42345f4385 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:43.186461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 818/1626] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:42 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:43.193078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b301-47c9-47d5-bbed-c39964a240ec None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.194759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b301-47c9-47d5-bbed-c39964a240ec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.195143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b301-47c9-47d5-bbed-c39964a240ec None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.204637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 819/1627] 10.222.0.46 () {54 vars in 912 bytes} [Wed Jun 8 12:59:43 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:59:43.206923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781b301-47c9-47d5-bbed-c39964a240ec None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:43.234386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e313cbd-72f7-4a67-8722-5a01198bccee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:43.236741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e313cbd-72f7-4a67-8722-5a01198bccee service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:43.237676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781b301-47c9-47d5-bbed-c39964a240ec None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:43.248684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c84f-6378-4208-bf55-4b7a57189388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:43.249420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c84f-6378-4208-bf55-4b7a57189388 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.249702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c84f-6378-4208-bf55-4b7a57189388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.252346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c84f-6378-4208-bf55-4b7a57189388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.254271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2c84f-6378-4208-bf55-4b7a57189388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:43.258615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2c84f-6378-4208-bf55-4b7a57189388 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:43.261041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 809/1628] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:43.263343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0b213-18e7-4d26-9ddc-0c04260d0953 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.264512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0b213-18e7-4d26-9ddc-0c04260d0953 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.265194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0b213-18e7-4d26-9ddc-0c04260d0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.289059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 820/1629] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:43.290106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c84f-6378-4208-bf55-4b7a57189388 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:43.312089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-59a0b213-18e7-4d26-9ddc-0c04260d0953 None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:43.316153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c84f-6378-4208-bf55-4b7a57189388 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:43.316974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-59a0b213-18e7-4d26-9ddc-0c04260d0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:43.326728 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13065-b2f1-44ab-bd48-549aae66de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:43.331402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13065-b2f1-44ab-bd48-549aae66de7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.331725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13065-b2f1-44ab-bd48-549aae66de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.333374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13065-b2f1-44ab-bd48-549aae66de7f admin admin] PATH_INFO: `/v3/projects/b43cb1afb4984bd69f861f78df3188b9/users/cad0153b966b4685b1cedc182c099df2/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.371035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a13065-b2f1-44ab-bd48-549aae66de7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43cb1afb4984bd69f861f78df3188b9, user_id=cad0153b966b4685b1cedc182c099df2, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:43.373802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a13065-b2f1-44ab-bd48-549aae66de7f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:43.386524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:43.405138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 821/1630] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:43 2022] PUT /identity/v3/projects/b43cb1afb4984bd69f861f78df3188b9/users/cad0153b966b4685b1cedc182c099df2/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:43.413166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13065-b2f1-44ab-bd48-549aae66de7f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:43.508549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 810/1631] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:43.510355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0786-8b82-4534-bd4b-ed0759b7e4ed None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.510643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0786-8b82-4534-bd4b-ed0759b7e4ed None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.510934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0786-8b82-4534-bd4b-ed0759b7e4ed None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.518058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 811/1632] 10.222.0.46 () {54 vars in 912 bytes} [Wed Jun 8 12:59:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:59:43.518943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0786-8b82-4534-bd4b-ed0759b7e4ed None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:43.525820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-404f0786-8b82-4534-bd4b-ed0759b7e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:43.569173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:43.574832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13065-b2f1-44ab-bd48-549aae66de7f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:43.587241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f517f28-82d5-49ef-a671-6a8d0e40510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:43.588017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f517f28-82d5-49ef-a671-6a8d0e40510f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.588331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f517f28-82d5-49ef-a671-6a8d0e40510f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.588698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f517f28-82d5-49ef-a671-6a8d0e40510f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.589518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f517f28-82d5-49ef-a671-6a8d0e40510f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:43.591149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f517f28-82d5-49ef-a671-6a8d0e40510f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:43.626420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 822/1633] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:43.627926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f9d8-a377-4b32-8ad9-2c1ea8a27d64 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.628227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f9d8-a377-4b32-8ad9-2c1ea8a27d64 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.628524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f9d8-a377-4b32-8ad9-2c1ea8a27d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.663310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0786-8b82-4534-bd4b-ed0759b7e4ed None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:43.671418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2e46f9d8-a377-4b32-8ad9-2c1ea8a27d64 None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:43.672673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2e46f9d8-a377-4b32-8ad9-2c1ea8a27d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:43.674253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267526eb-ff61-4686-ac3b-f77111e0fd13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:43.674934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267526eb-ff61-4686-ac3b-f77111e0fd13 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.675222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267526eb-ff61-4686-ac3b-f77111e0fd13 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.675505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267526eb-ff61-4686-ac3b-f77111e0fd13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.824870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267526eb-ff61-4686-ac3b-f77111e0fd13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:43.826387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267526eb-ff61-4686-ac3b-f77111e0fd13 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:43.831687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 823/1634] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:43.832559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46f9d8-a377-4b32-8ad9-2c1ea8a27d64 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:43.844878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46f9d8-a377-4b32-8ad9-2c1ea8a27d64 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:43.851162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87d5c2-dcb5-4fb4-bb10-5f9851ab7230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:43.852709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d5c2-dcb5-4fb4-bb10-5f9851ab7230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.853640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d5c2-dcb5-4fb4-bb10-5f9851ab7230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.854172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d5c2-dcb5-4fb4-bb10-5f9851ab7230 admin admin] PATH_INFO: `/v3/projects/b43cb1afb4984bd69f861f78df3188b9/users/cad0153b966b4685b1cedc182c099df2/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.856464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87d5c2-dcb5-4fb4-bb10-5f9851ab7230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43cb1afb4984bd69f861f78df3188b9, user_id=cad0153b966b4685b1cedc182c099df2, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:43.859732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87d5c2-dcb5-4fb4-bb10-5f9851ab7230 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:43.864207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 812/1635] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:43.868313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267526eb-ff61-4686-ac3b-f77111e0fd13 service glance] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:43.898644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 824/1636] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:43 2022] PUT /identity/v3/projects/b43cb1afb4984bd69f861f78df3188b9/users/cad0153b966b4685b1cedc182c099df2/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:43.906946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de667e-8205-4ec8-90ae-987dc5a3ca0c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:43.907381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de667e-8205-4ec8-90ae-987dc5a3ca0c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:43.907920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de667e-8205-4ec8-90ae-987dc5a3ca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:43.985918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c2de667e-8205-4ec8-90ae-987dc5a3ca0c None None] MFA Rules not processed for user `cad0153b966b4685b1cedc182c099df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:43.988112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c2de667e-8205-4ec8-90ae-987dc5a3ca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:44.030451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267526eb-ff61-4686-ac3b-f77111e0fd13 service glance] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:44.095839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:44.114587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 825/1637] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:59:44.148437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb6eba-a9e6-4e9a-be17-93fcfc86ad23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:44.149220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6eba-a9e6-4e9a-be17-93fcfc86ad23 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:44.149515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6eba-a9e6-4e9a-be17-93fcfc86ad23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:44.150274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6eba-a9e6-4e9a-be17-93fcfc86ad23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:44.240236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:44.339662 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de667e-8205-4ec8-90ae-987dc5a3ca0c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:44.366758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de667e-8205-4ec8-90ae-987dc5a3ca0c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:44.371449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ed546-2018-41e2-8770-a2364d0cd184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:44.372782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ed546-2018-41e2-8770-a2364d0cd184 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:44.373087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ed546-2018-41e2-8770-a2364d0cd184 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:44.373378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ed546-2018-41e2-8770-a2364d0cd184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:44.386143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ed546-2018-41e2-8770-a2364d0cd184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:44.394293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ed546-2018-41e2-8770-a2364d0cd184 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:44.409415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 826/1638] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:44.432824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb6eba-a9e6-4e9a-be17-93fcfc86ad23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:44.441327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb6eba-a9e6-4e9a-be17-93fcfc86ad23 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:44.483111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 813/1639] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:44.570782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666cb5f-418f-4c73-a94f-b914433c9682 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:44.571261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666cb5f-418f-4c73-a94f-b914433c9682 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:44.571573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666cb5f-418f-4c73-a94f-b914433c9682 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:44.574593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 827/1640] 10.222.0.46 () {54 vars in 912 bytes} [Wed Jun 8 12:59:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:59:44.587546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a0c6-7b2a-4b16-987c-7eed26e71035 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:44.588430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a0c6-7b2a-4b16-987c-7eed26e71035 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:44.588842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a0c6-7b2a-4b16-987c-7eed26e71035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:44.762934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cdd5a0c6-7b2a-4b16-987c-7eed26e71035 None None] MFA Rules not processed for user `98d7ac35d0e846af97f3ca345ec2ac09`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:44.767367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cdd5a0c6-7b2a-4b16-987c-7eed26e71035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:44.785346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666cb5f-418f-4c73-a94f-b914433c9682 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:44.807989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666cb5f-418f-4c73-a94f-b914433c9682 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:44.816171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb473015-8d5e-4472-a1c6-ff6d7a132b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:44.818023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473015-8d5e-4472-a1c6-ff6d7a132b09 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:44.818317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473015-8d5e-4472-a1c6-ff6d7a132b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:44.818609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473015-8d5e-4472-a1c6-ff6d7a132b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:44.959767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 814/1641] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:44.961671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb473015-8d5e-4472-a1c6-ff6d7a132b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:44.964447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb473015-8d5e-4472-a1c6-ff6d7a132b09 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:44.997899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 828/1642] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:45.020396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5a0c6-7b2a-4b16-987c-7eed26e71035 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:45.042542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5a0c6-7b2a-4b16-987c-7eed26e71035 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:45.051252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3b3dd-9f08-4222-9717-1e2e070032ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:45.052450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b3dd-9f08-4222-9717-1e2e070032ba service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:45.053718 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b3dd-9f08-4222-9717-1e2e070032ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:45.055048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b3dd-9f08-4222-9717-1e2e070032ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:45.074593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3b3dd-9f08-4222-9717-1e2e070032ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:45.077184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3b3dd-9f08-4222-9717-1e2e070032ba service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:45.112678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 815/1643] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:46.751517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfd5eb-c39e-4b12-b11d-ced019c14c8c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:46.752141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfd5eb-c39e-4b12-b11d-ced019c14c8c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:46.756091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfd5eb-c39e-4b12-b11d-ced019c14c8c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:46.759318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 829/1644] 10.222.0.46 () {54 vars in 960 bytes} [Wed Jun 8 12:59:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:59:46.769422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2952d-0937-4d01-b727-e450f96ba576 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:46.770118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2952d-0937-4d01-b727-e450f96ba576 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:46.770118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2952d-0937-4d01-b727-e450f96ba576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:46.813529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-26b2952d-0937-4d01-b727-e450f96ba576 None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:46.814833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-26b2952d-0937-4d01-b727-e450f96ba576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:47.116945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 816/1645] 10.222.0.46 () {58 vars in 1057 bytes} [Wed Jun 8 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:47.126994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfd5eb-c39e-4b12-b11d-ced019c14c8c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:47.154928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfd5eb-c39e-4b12-b11d-ced019c14c8c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:47.166643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13e39d-f8f7-4294-ab71-2aecad7aab6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:47.167655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13e39d-f8f7-4294-ab71-2aecad7aab6a service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:47.168083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13e39d-f8f7-4294-ab71-2aecad7aab6a service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:47.169257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13e39d-f8f7-4294-ab71-2aecad7aab6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:47.177298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba13e39d-f8f7-4294-ab71-2aecad7aab6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:47.225618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13e39d-f8f7-4294-ab71-2aecad7aab6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:47.227779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13e39d-f8f7-4294-ab71-2aecad7aab6a service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:47.272147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 830/1646] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:48.823920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2952d-0937-4d01-b727-e450f96ba576 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:48.968759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:49.035815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2952d-0937-4d01-b727-e450f96ba576 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:49.059442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:49.061131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:49.061627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:49.062116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] PATH_INFO: `/v3/users/9150082f9a3742f1a54c55930283ca03` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:49.064814 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9150082f9a3742f1a54c55930283ca03)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:49.070247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:59:49.070247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jun 08 12:59:49.070247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: Jun 08 12:59:49.075431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:49.255576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9150082f9a3742f1a54c55930283ca03'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:49.257727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9150082f9a3742f1a54c55930283ca03'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:49.293387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9150082f9a3742f1a54c55930283ca03'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:49.323516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9150082f9a3742f1a54c55930283ca03'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:49.324958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9150082f9a3742f1a54c55930283ca03'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:49.405004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 817/1647] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 12:59:48 2022] DELETE /identity/v3/users/9150082f9a3742f1a54c55930283ca03 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:49.410405 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370efc-b532-4c8b-9f8e-42da5628d356 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:49.410973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370efc-b532-4c8b-9f8e-42da5628d356 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:49.411088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3370efc-b532-4c8b-9f8e-42da5628d356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:49.456549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c3370efc-b532-4c8b-9f8e-42da5628d356 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:49.458439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c3370efc-b532-4c8b-9f8e-42da5628d356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:49.668782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 831/1648] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:49.773927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:49.775959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:49.952799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb3fd-5f1f-4093-91e6-956d67988c9d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:49.966439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08099370-3936-4775-936a-706bfc3a2e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:49.967072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099370-3936-4775-936a-706bfc3a2e57 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:49.967489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099370-3936-4775-936a-706bfc3a2e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:49.967635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099370-3936-4775-936a-706bfc3a2e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:49.986151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08099370-3936-4775-936a-706bfc3a2e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:49.992050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08099370-3936-4775-936a-706bfc3a2e57 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:50.028684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 818/1649] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:52.559103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3370efc-b532-4c8b-9f8e-42da5628d356 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:52.560704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c3370efc-b532-4c8b-9f8e-42da5628d356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:52.593688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3370efc-b532-4c8b-9f8e-42da5628d356 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:52.621839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:52.623319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:52.627971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:52.628492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] PATH_INFO: `/v3/projects/e45a1593b33a44b89b3d88ce463084fb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:52.634360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45a1593b33a44b89b3d88ce463084fb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:52.635946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: WARNING py.warnings [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:59:52.635946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: warnings.warn(msg) Jun 08 12:59:52.635946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: Jun 08 12:59:52.637193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:52.847265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45a1593b33a44b89b3d88ce463084fb', 'request_id': 'req-145a0c5b-b3b6-428d-b912-bc14130a02ac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:52.871503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45a1593b33a44b89b3d88ce463084fb', 'request_id': 'req-145a0c5b-b3b6-428d-b912-bc14130a02ac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:52.878739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:52.881951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45a1593b33a44b89b3d88ce463084fb', 'request_id': 'req-145a0c5b-b3b6-428d-b912-bc14130a02ac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:52.934767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] The token cache is being invalidate because project e45a1593b33a44b89b3d88ce463084fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:59:52.935072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:52.937080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-145a0c5b-b3b6-428d-b912-bc14130a02ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:59:52.943391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 832/1650] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 12:59:52 2022] DELETE /identity/v3/projects/e45a1593b33a44b89b3d88ce463084fb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:52.948761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d5d32-4c68-4046-8339-df1a99523eee None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:52.949297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d5d32-4c68-4046-8339-df1a99523eee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:52.949297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d5d32-4c68-4046-8339-df1a99523eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:53.004464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-071d5d32-4c68-4046-8339-df1a99523eee None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:53.005858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-071d5d32-4c68-4046-8339-df1a99523eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:53.251912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:53.283535 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 819/1651] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:59:53.289618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdae85-58f6-4ec8-b9d8-99e1260a15df None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:53.290641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdae85-58f6-4ec8-b9d8-99e1260a15df None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:53.291004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdae85-58f6-4ec8-b9d8-99e1260a15df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:53.324649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6cfdae85-58f6-4ec8-b9d8-99e1260a15df None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:53.326559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6cfdae85-58f6-4ec8-b9d8-99e1260a15df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:53.341148 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 833/1652] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:53.341932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d5d32-4c68-4046-8339-df1a99523eee None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:53.352570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d5d32-4c68-4046-8339-df1a99523eee None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:53.381693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:53.384824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:53.387582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:53.387981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:53.388936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:59:53.390287 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:53.395539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:53.431750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 820/1653] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 12:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:59:53.436539 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdae85-58f6-4ec8-b9d8-99e1260a15df None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:53.453134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdae85-58f6-4ec8-b9d8-99e1260a15df None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:53.466890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670a12c-cc2d-4577-88e0-25fe7ffaff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:53.470673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670a12c-cc2d-4577-88e0-25fe7ffaff98 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:53.470973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670a12c-cc2d-4577-88e0-25fe7ffaff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:53.471264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670a12c-cc2d-4577-88e0-25fe7ffaff98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:53.472012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670a12c-cc2d-4577-88e0-25fe7ffaff98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:53.481226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670a12c-cc2d-4577-88e0-25fe7ffaff98 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:53.561994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 834/1654] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:53 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:53.563456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:53.581768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328d1ac-d36a-4c79-942c-5a42ddaa0d27 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:53.744012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61229cdd-469a-404c-9c24-72a01536595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:53.744990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229cdd-469a-404c-9c24-72a01536595e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:53.745426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229cdd-469a-404c-9c24-72a01536595e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:53.745865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229cdd-469a-404c-9c24-72a01536595e admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:53.746812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61229cdd-469a-404c-9c24-72a01536595e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:53.752571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61229cdd-469a-404c-9c24-72a01536595e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:53.803886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 821/1655] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:53 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:59:53.807981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670a12c-cc2d-4577-88e0-25fe7ffaff98 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:53.832484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670a12c-cc2d-4577-88e0-25fe7ffaff98 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:53.854538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ece42-1ebe-449a-afcd-4bbdb5cbe32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:53.855399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ece42-1ebe-449a-afcd-4bbdb5cbe32c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:53.855695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ece42-1ebe-449a-afcd-4bbdb5cbe32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:53.855984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ece42-1ebe-449a-afcd-4bbdb5cbe32c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:53.856751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ece42-1ebe-449a-afcd-4bbdb5cbe32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:53.858451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ece42-1ebe-449a-afcd-4bbdb5cbe32c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:53.887642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 835/1656] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:53.892152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61229cdd-469a-404c-9c24-72a01536595e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:53.912247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61229cdd-469a-404c-9c24-72a01536595e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:53.924068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e1f30-6f0b-4e9a-ad5b-d5cd94d87242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:53.924782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e1f30-6f0b-4e9a-ad5b-d5cd94d87242 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:53.925077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e1f30-6f0b-4e9a-ad5b-d5cd94d87242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:53.926150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e1f30-6f0b-4e9a-ad5b-d5cd94d87242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:53.927088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e1f30-6f0b-4e9a-ad5b-d5cd94d87242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:53.930654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e1f30-6f0b-4e9a-ad5b-d5cd94d87242 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:53.973189 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ece42-1ebe-449a-afcd-4bbdb5cbe32c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:53.975431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 822/1657] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:53.991214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ece42-1ebe-449a-afcd-4bbdb5cbe32c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:54.001266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958f6fa-3de4-428f-8d15-4ab563ec66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:54.002264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958f6fa-3de4-428f-8d15-4ab563ec66b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:54.002555 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958f6fa-3de4-428f-8d15-4ab563ec66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:54.002842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958f6fa-3de4-428f-8d15-4ab563ec66b8 admin admin] PATH_INFO: `/v3/projects/32309b0835cc4b8eaea21da583fadb42/users/e8879b23eacb4c50a28ef56c26925e30/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:54.039616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958f6fa-3de4-428f-8d15-4ab563ec66b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32309b0835cc4b8eaea21da583fadb42, user_id=e8879b23eacb4c50a28ef56c26925e30, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:54.042815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958f6fa-3de4-428f-8d15-4ab563ec66b8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:54.084419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 836/1658] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:53 2022] PUT /identity/v3/projects/32309b0835cc4b8eaea21da583fadb42/users/e8879b23eacb4c50a28ef56c26925e30/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:54.086460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c709b8-dfdf-4c1b-aa21-e2d3007fb741 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:54.086820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c709b8-dfdf-4c1b-aa21-e2d3007fb741 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:54.087177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c709b8-dfdf-4c1b-aa21-e2d3007fb741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:54.142785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-82c709b8-dfdf-4c1b-aa21-e2d3007fb741 None None] MFA Rules not processed for user `e8879b23eacb4c50a28ef56c26925e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:54.145810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-82c709b8-dfdf-4c1b-aa21-e2d3007fb741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:54.333601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 823/1659] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:54.340281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958f6fa-3de4-428f-8d15-4ab563ec66b8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:54.550395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958f6fa-3de4-428f-8d15-4ab563ec66b8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:54.560240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65019a0c-e3a9-4a95-86a2-b7c355990bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:54.561180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65019a0c-e3a9-4a95-86a2-b7c355990bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:54.561748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65019a0c-e3a9-4a95-86a2-b7c355990bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:54.561873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65019a0c-e3a9-4a95-86a2-b7c355990bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:54.562613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65019a0c-e3a9-4a95-86a2-b7c355990bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:54.565987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65019a0c-e3a9-4a95-86a2-b7c355990bf5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:54.676507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 837/1660] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 12:59:54 2022] POST /identity/v3/projects => generated 365 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:54.687191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c709b8-dfdf-4c1b-aa21-e2d3007fb741 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:54.777877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c709b8-dfdf-4c1b-aa21-e2d3007fb741 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:54.948094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:54.986761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d14d8-332b-4b88-ba86-a487e59031c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:54.990075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d14d8-332b-4b88-ba86-a487e59031c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:54.993232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d14d8-332b-4b88-ba86-a487e59031c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:54.996341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d14d8-332b-4b88-ba86-a487e59031c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:54.997380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d14d8-332b-4b88-ba86-a487e59031c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:55.007513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d14d8-332b-4b88-ba86-a487e59031c1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:55.065187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65019a0c-e3a9-4a95-86a2-b7c355990bf5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:55.077064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 824/1661] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 12:59:54 2022] POST /identity/v3/users => generated 289 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:59:55.083111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65019a0c-e3a9-4a95-86a2-b7c355990bf5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:55.117626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3012cc-f01e-4aff-ba48-9cbf5c3ab3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:55.126130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3012cc-f01e-4aff-ba48-9cbf5c3ab3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:55.126877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3012cc-f01e-4aff-ba48-9cbf5c3ab3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:55.126877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3012cc-f01e-4aff-ba48-9cbf5c3ab3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:55.127599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3012cc-f01e-4aff-ba48-9cbf5c3ab3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:55.137209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3012cc-f01e-4aff-ba48-9cbf5c3ab3ee admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:55.176346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 838/1662] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:55.178338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d14d8-332b-4b88-ba86-a487e59031c1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:55.225050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d14d8-332b-4b88-ba86-a487e59031c1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:55.247017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383a54e-2cc2-4afb-a3c8-94548d35d1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:55.250536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a54e-2cc2-4afb-a3c8-94548d35d1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:55.251782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a54e-2cc2-4afb-a3c8-94548d35d1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:55.252742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a54e-2cc2-4afb-a3c8-94548d35d1c8 admin admin] PATH_INFO: `/v3/projects/1af989bdc00742b18bf209c1453e51ec/users/b9ac8420deb946a78ac34707d491532d/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:55.297139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cd8f-a396-4230-96b2-4e2b87253653 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:55.297811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cd8f-a396-4230-96b2-4e2b87253653 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:55.299110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cd8f-a396-4230-96b2-4e2b87253653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:55.316356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a54e-2cc2-4afb-a3c8-94548d35d1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af989bdc00742b18bf209c1453e51ec, user_id=b9ac8420deb946a78ac34707d491532d, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:55.320741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a54e-2cc2-4afb-a3c8-94548d35d1c8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:55.334699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4fb3cd8f-a396-4230-96b2-4e2b87253653 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:55.340070 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4fb3cd8f-a396-4230-96b2-4e2b87253653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:55.366031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 825/1663] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:55 2022] PUT /identity/v3/projects/1af989bdc00742b18bf209c1453e51ec/users/b9ac8420deb946a78ac34707d491532d/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:55.367325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383a54e-2cc2-4afb-a3c8-94548d35d1c8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:55.550576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 839/1664] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:59:55.574711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383a54e-2cc2-4afb-a3c8-94548d35d1c8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:55.581345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:55.583247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:55.583616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:55.583973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:55.584856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:55.587645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:55.656350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3cd8f-a396-4230-96b2-4e2b87253653 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:55.665176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 826/1665] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 12:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:59:55.695453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3cd8f-a396-4230-96b2-4e2b87253653 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:55.723740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509bfa1-09a6-4797-befd-32eab00e0114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:55.731598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509bfa1-09a6-4797-befd-32eab00e0114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:55.733471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509bfa1-09a6-4797-befd-32eab00e0114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:55.735314 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509bfa1-09a6-4797-befd-32eab00e0114 admin admin] PATH_INFO: `/v3/projects/1af989bdc00742b18bf209c1453e51ec/users/b9ac8420deb946a78ac34707d491532d/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:55.760364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509bfa1-09a6-4797-befd-32eab00e0114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af989bdc00742b18bf209c1453e51ec, user_id=b9ac8420deb946a78ac34707d491532d, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:55.770346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509bfa1-09a6-4797-befd-32eab00e0114 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:55.771895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:55.775329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:55.776313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:55.797011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 840/1666] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 12:59:55 2022] PUT /identity/v3/projects/1af989bdc00742b18bf209c1453e51ec/users/b9ac8420deb946a78ac34707d491532d/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:59:55.816056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0141a08-5e21-41c7-bb0a-81f129aca8fc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:55.816635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0141a08-5e21-41c7-bb0a-81f129aca8fc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:55.817019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0141a08-5e21-41c7-bb0a-81f129aca8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:55.875519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f0141a08-5e21-41c7-bb0a-81f129aca8fc None None] MFA Rules not processed for user `b9ac8420deb946a78ac34707d491532d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:55.876891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0141a08-5e21-41c7-bb0a-81f129aca8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:56.045049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 841/1667] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:59:56.082190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63a58-3b41-41f2-936e-d3190f2249a7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:56.170047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0141a08-5e21-41c7-bb0a-81f129aca8fc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:56.171920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0141a08-5e21-41c7-bb0a-81f129aca8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:56.247184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:59:56.273032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:56.274114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:56.274455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:56.274741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:56.385275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0141a08-5e21-41c7-bb0a-81f129aca8fc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:56.404070 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6093b74-5581-4f6e-beee-94aa6e643531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:56.405233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6093b74-5581-4f6e-beee-94aa6e643531 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:56.405850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6093b74-5581-4f6e-beee-94aa6e643531 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:56.406283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6093b74-5581-4f6e-beee-94aa6e643531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:56.424161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:56.426093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:56.437876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6093b74-5581-4f6e-beee-94aa6e643531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:56.439617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6093b74-5581-4f6e-beee-94aa6e643531 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:56.457061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 827/1668] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 12:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 12:59:56.459317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 842/1669] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:59:56.580230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:56.582911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:56.608013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317aa1c-caf3-4f2a-b411-ee0121c06083 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:56.616145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:56.617024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:56.617458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:56.618128 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:56.838326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:56.843680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:56.936682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 828/1670] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:59:59.176160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058658f-92bf-44dd-ae1b-f6ddb406e5c9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:59.176756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058658f-92bf-44dd-ae1b-f6ddb406e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:59.176756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058658f-92bf-44dd-ae1b-f6ddb406e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:59.270543 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9058658f-92bf-44dd-ae1b-f6ddb406e5c9 None None] MFA Rules not processed for user `8986cbf0b3534177a6436113896b161d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:59:59.278159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9058658f-92bf-44dd-ae1b-f6ddb406e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:59.448812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 843/1671] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 12:59:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:59:59.454829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:59:59.456484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:59:59.693657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d54f8-131f-4a71-ae62-c490404f939c service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:59:59.713792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95867b79-9d60-4f81-82ba-14d80f7025fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:59:59.716138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95867b79-9d60-4f81-82ba-14d80f7025fc service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:59:59.716997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95867b79-9d60-4f81-82ba-14d80f7025fc service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:59:59.718576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95867b79-9d60-4f81-82ba-14d80f7025fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:59:59.730603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95867b79-9d60-4f81-82ba-14d80f7025fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:59:59.732435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95867b79-9d60-4f81-82ba-14d80f7025fc service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:59:59.745891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 829/1672] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 12:59:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:00.087821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95eb86-24a9-444f-a0a7-9e0796c3a1b1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:00.087821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95eb86-24a9-444f-a0a7-9e0796c3a1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:00.087821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95eb86-24a9-444f-a0a7-9e0796c3a1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:00.149185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:00.183375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4d95eb86-24a9-444f-a0a7-9e0796c3a1b1 None None] MFA Rules not processed for user `2a550d483fee4f84a11dccf72fc85dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:00.195783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4d95eb86-24a9-444f-a0a7-9e0796c3a1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:00.520552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 844/1673] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:00.531059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da33c1a-4be5-486b-8862-8ddcae2d1b04 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:00.531993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da33c1a-4be5-486b-8862-8ddcae2d1b04 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:00.532435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da33c1a-4be5-486b-8862-8ddcae2d1b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:00.566099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7da33c1a-4be5-486b-8862-8ddcae2d1b04 None None] MFA Rules not processed for user `2a550d483fee4f84a11dccf72fc85dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:00.568057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7da33c1a-4be5-486b-8862-8ddcae2d1b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:00.617954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 830/1674] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:00.619140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95eb86-24a9-444f-a0a7-9e0796c3a1b1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:00.654996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95eb86-24a9-444f-a0a7-9e0796c3a1b1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:00.676442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654cf43-cf73-4bf7-81b2-cbc509eb0e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:00.678552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654cf43-cf73-4bf7-81b2-cbc509eb0e25 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:00.682247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654cf43-cf73-4bf7-81b2-cbc509eb0e25 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:00.683332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654cf43-cf73-4bf7-81b2-cbc509eb0e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:00.724502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654cf43-cf73-4bf7-81b2-cbc509eb0e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:00.732706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654cf43-cf73-4bf7-81b2-cbc509eb0e25 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:00.770764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 845/1675] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:00.992031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da33c1a-4be5-486b-8862-8ddcae2d1b04 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:00.994501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7da33c1a-4be5-486b-8862-8ddcae2d1b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:01.034311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:01.192917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da33c1a-4be5-486b-8862-8ddcae2d1b04 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:01.211026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:01.211996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:01.212290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:01.212576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] PATH_INFO: `/v3/users/a3331ce8e39c4ec2ab1367f9d88441e1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:01.238823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3331ce8e39c4ec2ab1367f9d88441e1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:01.241049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:01.498113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3331ce8e39c4ec2ab1367f9d88441e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:01.500657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3331ce8e39c4ec2ab1367f9d88441e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:01.552754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3331ce8e39c4ec2ab1367f9d88441e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:01.587664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3331ce8e39c4ec2ab1367f9d88441e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:01.590169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3331ce8e39c4ec2ab1367f9d88441e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:01.659454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 831/1676] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:00 2022] DELETE /identity/v3/users/a3331ce8e39c4ec2ab1367f9d88441e1 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:01.667377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a324d-b36b-4c04-a126-15131f59bd71 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:01.667939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a324d-b36b-4c04-a126-15131f59bd71 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:01.668099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a324d-b36b-4c04-a126-15131f59bd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:01.720117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ac5a324d-b36b-4c04-a126-15131f59bd71 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:01.724303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ac5a324d-b36b-4c04-a126-15131f59bd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:01.936229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 846/1677] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:02.110893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:02.112708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:02.196798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a58f-b42a-425c-a3e1-419ab1fec882 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:02.197023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a58f-b42a-425c-a3e1-419ab1fec882 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:02.197576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a58f-b42a-425c-a3e1-419ab1fec882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:02.280046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d759a58f-b42a-425c-a3e1-419ab1fec882 None None] MFA Rules not processed for user `dcd4aeea3a094122a7c7c6944b96cb71`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:02.283868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d759a58f-b42a-425c-a3e1-419ab1fec882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:02.335445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37691c49-338a-4118-95ab-18bd349c6a03 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:02.358832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:02.359637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:02.359926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:02.360286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:02.392229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:02.394255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:02.431548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 832/1678] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:02.551325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 847/1679] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:02.571576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:02.574149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:02.680066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a58f-b42a-425c-a3e1-419ab1fec882 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:02.682869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d759a58f-b42a-425c-a3e1-419ab1fec882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:02.688584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:02.719484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a58f-b42a-425c-a3e1-419ab1fec882 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:02.746949 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:02.747863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:02.748152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:02.748435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] PATH_INFO: `/v3/users/594589127d3442b090d05d11b82d3eaa` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:02.754896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=594589127d3442b090d05d11b82d3eaa)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:02.760585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:02.816241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:02.828344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd5878-4259-456d-aa28-93a8148166d8 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:02.848938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa13a7-4232-441c-b9a1-c11fc05df985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:02.850035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa13a7-4232-441c-b9a1-c11fc05df985 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:02.850552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa13a7-4232-441c-b9a1-c11fc05df985 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:02.850998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa13a7-4232-441c-b9a1-c11fc05df985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:02.884466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa13a7-4232-441c-b9a1-c11fc05df985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:02.886415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa13a7-4232-441c-b9a1-c11fc05df985 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:02.928686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 833/1680] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:02.938705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c381-9eea-49a0-9426-52a86a8700ca None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:02.939008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c381-9eea-49a0-9426-52a86a8700ca None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:02.939298 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c381-9eea-49a0-9426-52a86a8700ca None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:02.940812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 834/1681] 10.222.0.46 () {54 vars in 912 bytes} [Wed Jun 8 13:00:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:00:02.949769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc33914-9b2e-4a21-9598-bfce57f5ea1b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:02.950067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc33914-9b2e-4a21-9598-bfce57f5ea1b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:02.950356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc33914-9b2e-4a21-9598-bfce57f5ea1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:02.956686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594589127d3442b090d05d11b82d3eaa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:02.957532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594589127d3442b090d05d11b82d3eaa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:02.986970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594589127d3442b090d05d11b82d3eaa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:03.027197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-acc33914-9b2e-4a21-9598-bfce57f5ea1b None None] MFA Rules not processed for user `98d7ac35d0e846af97f3ca345ec2ac09`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:03.028531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-acc33914-9b2e-4a21-9598-bfce57f5ea1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:03.033274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594589127d3442b090d05d11b82d3eaa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:03.058950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594589127d3442b090d05d11b82d3eaa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:03.067111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 835/1682] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:03.076468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 848/1683] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:02 2022] DELETE /identity/v3/users/594589127d3442b090d05d11b82d3eaa => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:03.081180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3f4e7-c933-44b0-86e0-3b5edd5261be None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:03.081725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3f4e7-c933-44b0-86e0-3b5edd5261be None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:03.082150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3f4e7-c933-44b0-86e0-3b5edd5261be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:03.127005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0fb3f4e7-c933-44b0-86e0-3b5edd5261be None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:03.128524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0fb3f4e7-c933-44b0-86e0-3b5edd5261be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:03.142786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:03.144261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:03.285399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 836/1684] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:03.342827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3f4e7-c933-44b0-86e0-3b5edd5261be None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:03.344836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0fb3f4e7-c933-44b0-86e0-3b5edd5261be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:03.522988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3f4e7-c933-44b0-86e0-3b5edd5261be None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:03.543400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:03.544112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:03.544543 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:03.544976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:03.580798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e8428-e2c9-4cba-b682-106efad2f785 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:03.585084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:03.604468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:03.620221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:03.625480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:03.627255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:03.627564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] PATH_INFO: `/v3/users/e8879b23eacb4c50a28ef56c26925e30` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:03.637972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8879b23eacb4c50a28ef56c26925e30)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:03.646283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:03.675238 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 837/1685] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:03.676303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:03.685311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:03.721894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8e5dc-51e2-4942-9350-5354b35d5c3f service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:03.746682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c595083-0881-4b95-91c5-545aac4b7a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:03.747789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595083-0881-4b95-91c5-545aac4b7a26 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:03.748360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595083-0881-4b95-91c5-545aac4b7a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:03.748908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595083-0881-4b95-91c5-545aac4b7a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:03.787848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c595083-0881-4b95-91c5-545aac4b7a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:03.789054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8879b23eacb4c50a28ef56c26925e30'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:03.791391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8879b23eacb4c50a28ef56c26925e30'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:03.794848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c595083-0881-4b95-91c5-545aac4b7a26 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:03.809764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8879b23eacb4c50a28ef56c26925e30'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:03.828660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8879b23eacb4c50a28ef56c26925e30'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:03.839474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-19c34aa1-1abd-4568-a129-1fa6f8ec9c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8879b23eacb4c50a28ef56c26925e30'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:03.849930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 838/1686] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:03.851585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce58d-2cc6-4437-8a0c-cb644368a538 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:03.851912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce58d-2cc6-4437-8a0c-cb644368a538 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:03.853123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce58d-2cc6-4437-8a0c-cb644368a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:03.855640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 849/1687] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:03 2022] DELETE /identity/v3/users/e8879b23eacb4c50a28ef56c26925e30 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:03.860153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648c48-9a46-4a28-a67d-2ba12537427b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:03.860483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648c48-9a46-4a28-a67d-2ba12537427b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:03.860830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648c48-9a46-4a28-a67d-2ba12537427b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:03.905948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f7648c48-9a46-4a28-a67d-2ba12537427b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:03.909779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f7648c48-9a46-4a28-a67d-2ba12537427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:03.917499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dc0ce58d-2cc6-4437-8a0c-cb644368a538 None None] MFA Rules not processed for user `98d7ac35d0e846af97f3ca345ec2ac09`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:03.919367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dc0ce58d-2cc6-4437-8a0c-cb644368a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:03.920079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:04.041746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:04.087973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 839/1688] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jun 8 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:04.132820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 850/1689] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:04.157149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce58d-2cc6-4437-8a0c-cb644368a538 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:04.159577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dc0ce58d-2cc6-4437-8a0c-cb644368a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:04.181695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce58d-2cc6-4437-8a0c-cb644368a538 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:04.197119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050de90-526b-4c2d-979e-6cf623fef35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:04.197849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050de90-526b-4c2d-979e-6cf623fef35b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:04.198226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050de90-526b-4c2d-979e-6cf623fef35b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:04.204394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050de90-526b-4c2d-979e-6cf623fef35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:04.229140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050de90-526b-4c2d-979e-6cf623fef35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:04.230657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050de90-526b-4c2d-979e-6cf623fef35b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:04.258393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 840/1690] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:04.306859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7648c48-9a46-4a28-a67d-2ba12537427b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:04.309169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f7648c48-9a46-4a28-a67d-2ba12537427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:04.333931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7648c48-9a46-4a28-a67d-2ba12537427b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:04.338724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:04.339416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:04.339714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:04.340004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:04.376249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:04.377730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:04.406286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 851/1691] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:04.643541 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b8dc-e9ba-4f44-a788-3ca5e342674a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:04.644131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b8dc-e9ba-4f44-a788-3ca5e342674a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:04.644131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b8dc-e9ba-4f44-a788-3ca5e342674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:04.728815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-baa0b8dc-e9ba-4f44-a788-3ca5e342674a None None] MFA Rules not processed for user `8986cbf0b3534177a6436113896b161d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:04.735418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-baa0b8dc-e9ba-4f44-a788-3ca5e342674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:04.951809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 841/1692] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:05.658381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:05.667473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:05.736314 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36bb38-fc53-4ada-a3ba-10c899dadcaf service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:05.767153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:05.768232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:05.768524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:05.769241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] PATH_INFO: `/v3/projects/6b8bbf588d644cac83a150f00795cdc0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:05.775123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8bbf588d644cac83a150f00795cdc0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:05.777205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:05.976627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b8dc-e9ba-4f44-a788-3ca5e342674a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:05.986515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-baa0b8dc-e9ba-4f44-a788-3ca5e342674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:06.072390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b8dc-e9ba-4f44-a788-3ca5e342674a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:06.077524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8bbf588d644cac83a150f00795cdc0', 'request_id': 'req-a21ebeb1-aacc-43be-a67e-b35424236891'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.128152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8bbf588d644cac83a150f00795cdc0', 'request_id': 'req-a21ebeb1-aacc-43be-a67e-b35424236891'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.178293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8bbf588d644cac83a150f00795cdc0', 'request_id': 'req-a21ebeb1-aacc-43be-a67e-b35424236891'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.250721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] The token cache is being invalidate because project 6b8bbf588d644cac83a150f00795cdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:06.251026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.252520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a21ebeb1-aacc-43be-a67e-b35424236891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.263855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 852/1693] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:05 2022] DELETE /identity/v3/projects/6b8bbf588d644cac83a150f00795cdc0 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:06.273153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7025-8544-47a3-9267-4836c5cc94f4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:06.274090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7025-8544-47a3-9267-4836c5cc94f4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:06.275398 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7025-8544-47a3-9267-4836c5cc94f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:06.364954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f93a7025-8544-47a3-9267-4836c5cc94f4 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:06.372164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f93a7025-8544-47a3-9267-4836c5cc94f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:06.401788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:06.416382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:06.417228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:06.417584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] PATH_INFO: `/v3/projects/32309b0835cc4b8eaea21da583fadb42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:06.421260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32309b0835cc4b8eaea21da583fadb42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:06.427720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:06.441886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 853/1694] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:06.444181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed26f-ea59-4372-a834-398b1f2c95ee None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:06.444373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed26f-ea59-4372-a834-398b1f2c95ee None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:06.444599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed26f-ea59-4372-a834-398b1f2c95ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:06.513096 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b23ed26f-ea59-4372-a834-398b1f2c95ee None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:06.514692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b23ed26f-ea59-4372-a834-398b1f2c95ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:06.549449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 854/1695] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:06.552079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ed26f-ea59-4372-a834-398b1f2c95ee None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:06.577238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ed26f-ea59-4372-a834-398b1f2c95ee None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:06.595935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32309b0835cc4b8eaea21da583fadb42', 'request_id': 'req-538c0d91-ef54-4525-a1d5-88b47ac048f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.621143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32309b0835cc4b8eaea21da583fadb42', 'request_id': 'req-538c0d91-ef54-4525-a1d5-88b47ac048f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.644334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32309b0835cc4b8eaea21da583fadb42', 'request_id': 'req-538c0d91-ef54-4525-a1d5-88b47ac048f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.685807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] The token cache is being invalidate because project 32309b0835cc4b8eaea21da583fadb42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:06.686107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.687049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.699933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 842/1696] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:05 2022] DELETE /identity/v3/projects/32309b0835cc4b8eaea21da583fadb42 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:06.702646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:06.705400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:06.755403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:06.778758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:06.779455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:06.779747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:06.781837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:06.782716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:06.783071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:06.788283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:06.810065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:06.817815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 855/1697] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:06.828203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:06.833298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:06.882067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c0d91-ef54-4525-a1d5-88b47ac048f6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:06.884238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d5ff-7e9b-454e-aeeb-7370fdf79243 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:06.888611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:06.889763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:06.890054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:06.890337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] PATH_INFO: `/v3/users/b9ac8420deb946a78ac34707d491532d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:06.900882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ac8420deb946a78ac34707d491532d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:06.902815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:06.902947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:06.903521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:06.903825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:06.908242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:06.909153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:06.917942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:06.987205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ac8420deb946a78ac34707d491532d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:06.988130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ac8420deb946a78ac34707d491532d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:07.003986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ac8420deb946a78ac34707d491532d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:07.019949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ac8420deb946a78ac34707d491532d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:07.020798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ac8420deb946a78ac34707d491532d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:07.023663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 856/1698] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:06 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:07.028697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:07.032994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:07.054724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 843/1699] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:06 2022] DELETE /identity/v3/users/b9ac8420deb946a78ac34707d491532d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:07.150110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15597a-1ab6-4196-8e8e-5a644b9cc061 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:07.340170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5baadb-b1b7-4a60-ae47-b23f8f3b998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:07.342999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5baadb-b1b7-4a60-ae47-b23f8f3b998f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:07.343197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5baadb-b1b7-4a60-ae47-b23f8f3b998f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:07.343453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5baadb-b1b7-4a60-ae47-b23f8f3b998f admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:07.344185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5baadb-b1b7-4a60-ae47-b23f8f3b998f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:07.359862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5baadb-b1b7-4a60-ae47-b23f8f3b998f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:07.406062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 857/1700] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:07 2022] POST /identity/v3/users => generated 284 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:07.410292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:07.433424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb09570-c17b-41f1-a2c6-5156ccce4995 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:07.442124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea53a1-52d4-4601-b06c-69e69c41d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:07.443634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea53a1-52d4-4601-b06c-69e69c41d280 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:07.444066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea53a1-52d4-4601-b06c-69e69c41d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:07.444489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea53a1-52d4-4601-b06c-69e69c41d280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:07.445397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea53a1-52d4-4601-b06c-69e69c41d280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:07.449502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea53a1-52d4-4601-b06c-69e69c41d280 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:07.473727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 844/1701] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:07.479180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5baadb-b1b7-4a60-ae47-b23f8f3b998f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:07.497913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5baadb-b1b7-4a60-ae47-b23f8f3b998f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:07.510853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:07.514289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:07.514831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:07.516393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:07.518419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:07.529113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:07.580817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 858/1702] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:07.586074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea53a1-52d4-4601-b06c-69e69c41d280 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:07.599428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea53a1-52d4-4601-b06c-69e69c41d280 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:07.614570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:07.615712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:07.615852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:07.616240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] PATH_INFO: `/v3/projects/e2b4cdd4452d400c92673b7aeedf2b72/users/ac8084e2d11645d49494e4f75642bead/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:07.622704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:07.628897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:07.646280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b4cdd4452d400c92673b7aeedf2b72, user_id=ac8084e2d11645d49494e4f75642bead, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:07.650054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:07.668554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21805-05ec-42eb-9051-63ca7a1fad49 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:07.681490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 845/1703] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:07 2022] PUT /identity/v3/projects/e2b4cdd4452d400c92673b7aeedf2b72/users/ac8084e2d11645d49494e4f75642bead/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:07.681490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:07.690121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:07.840906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:07.843195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:07.844147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:07.846254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] PATH_INFO: `/v3/projects/1af989bdc00742b18bf209c1453e51ec` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:07.848277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af989bdc00742b18bf209c1453e51ec)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:07.850306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf99f5-08de-4681-bfe8-1af5e17dfafe admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:07.854139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:07.887251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:07.890639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:07.895467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:07.896445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:07.898773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] PATH_INFO: `/v3/projects/796d808da3574f12ac77e1c9e31ec420` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:07.909122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=796d808da3574f12ac77e1c9e31ec420)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:07.927719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:07.927719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:08.044356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af989bdc00742b18bf209c1453e51ec', 'request_id': 'req-37dcc2d9-4b0d-4f1a-a870-95d900875614'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.052575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796d808da3574f12ac77e1c9e31ec420', 'request_id': 'req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.068996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796d808da3574f12ac77e1c9e31ec420', 'request_id': 'req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.069789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af989bdc00742b18bf209c1453e51ec', 'request_id': 'req-37dcc2d9-4b0d-4f1a-a870-95d900875614'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.084296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796d808da3574f12ac77e1c9e31ec420', 'request_id': 'req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.090276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af989bdc00742b18bf209c1453e51ec', 'request_id': 'req-37dcc2d9-4b0d-4f1a-a870-95d900875614'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.124517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] The token cache is being invalidate because project 796d808da3574f12ac77e1c9e31ec420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:08.124894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.127055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0cb88c3a-d93a-41be-99a5-6e5bec21d06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.132564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 846/1704] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:07 2022] DELETE /identity/v3/projects/796d808da3574f12ac77e1c9e31ec420 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:08.136043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea0fde-b68b-45cf-bbbb-5dd7cfc0973a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:08.136881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea0fde-b68b-45cf-bbbb-5dd7cfc0973a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:08.137459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea0fde-b68b-45cf-bbbb-5dd7cfc0973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:08.156128 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] The token cache is being invalidate because project 1af989bdc00742b18bf209c1453e51ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:08.156758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.162832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-37dcc2d9-4b0d-4f1a-a870-95d900875614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.179881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 859/1705] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:07 2022] DELETE /identity/v3/projects/1af989bdc00742b18bf209c1453e51ec => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:08.187313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9ac14-d0c8-40a3-a620-1deefd298c77 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:08.190553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9ac14-d0c8-40a3-a620-1deefd298c77 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:08.195254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9ac14-d0c8-40a3-a620-1deefd298c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:08.214712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-00ea0fde-b68b-45cf-bbbb-5dd7cfc0973a None None] MFA Rules not processed for user `ac8084e2d11645d49494e4f75642bead`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:08.216785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-00ea0fde-b68b-45cf-bbbb-5dd7cfc0973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:08.314675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-49a9ac14-d0c8-40a3-a620-1deefd298c77 None None] MFA Rules not processed for user `80ffae178b294666b137bf69233eef46`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:08.322175 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-49a9ac14-d0c8-40a3-a620-1deefd298c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:08.412317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 847/1706] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:08.416340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea0fde-b68b-45cf-bbbb-5dd7cfc0973a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:08.422761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-00ea0fde-b68b-45cf-bbbb-5dd7cfc0973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:08.591739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 860/1707] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:08.591739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d352192-bf30-44cf-85b5-66313c7568d6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:08.591739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d352192-bf30-44cf-85b5-66313c7568d6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:08.591739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d352192-bf30-44cf-85b5-66313c7568d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:08.660261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7d352192-bf30-44cf-85b5-66313c7568d6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:08.668603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d352192-bf30-44cf-85b5-66313c7568d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:08.700989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea0fde-b68b-45cf-bbbb-5dd7cfc0973a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:08.724829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:08.725838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:08.726120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:08.726440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] PATH_INFO: `/v3/users/cad0153b966b4685b1cedc182c099df2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:08.732852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad0153b966b4685b1cedc182c099df2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:08.734946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:08.829500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:08.895479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 861/1708] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:08.896347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d352192-bf30-44cf-85b5-66313c7568d6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:08.897786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad0153b966b4685b1cedc182c099df2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.898590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad0153b966b4685b1cedc182c099df2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.902549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d352192-bf30-44cf-85b5-66313c7568d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:08.928850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad0153b966b4685b1cedc182c099df2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.939760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d352192-bf30-44cf-85b5-66313c7568d6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:08.948224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad0153b966b4685b1cedc182c099df2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.949195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd751acd-9c60-405a-8ad4-d2ae4cb5f06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad0153b966b4685b1cedc182c099df2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:08.956794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:08.957425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:08.960434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:08.960434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:08.967334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:08.969674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:09.055885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 848/1709] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:08 2022] DELETE /identity/v3/users/cad0153b966b4685b1cedc182c099df2 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:09.058322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2c0f-7555-4483-b3b5-849287eb0a9a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:09.058654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2c0f-7555-4483-b3b5-849287eb0a9a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:09.059010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2c0f-7555-4483-b3b5-849287eb0a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:09.150139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 862/1710] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:08 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:09.151375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:09.159715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:09.174095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cfad2c0f-7555-4483-b3b5-849287eb0a9a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:09.175613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:09.188697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cfad2c0f-7555-4483-b3b5-849287eb0a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:09.432103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 849/1711] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:09.434078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2c0f-7555-4483-b3b5-849287eb0a9a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:09.475061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2c0f-7555-4483-b3b5-849287eb0a9a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:09.489907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:09.490630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:09.490921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:09.491206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:09.497035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:09.497493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:09.503017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:09.550578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 850/1712] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:09.557261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:09.610720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6ad8-b92a-4597-8de1-f19ffa0ee0a0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:09.629311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb4034-a765-47ce-9ef0-b94c3cbded2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:09.630070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb4034-a765-47ce-9ef0-b94c3cbded2d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:09.630364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb4034-a765-47ce-9ef0-b94c3cbded2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:09.632446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb4034-a765-47ce-9ef0-b94c3cbded2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:09.642038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb4034-a765-47ce-9ef0-b94c3cbded2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:09.644843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb4034-a765-47ce-9ef0-b94c3cbded2d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:09.667061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36770-0141-487d-952d-a202947a9d8c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:09.674247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9df932-c67f-4896-bf90-055921dd836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:09.676127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9df932-c67f-4896-bf90-055921dd836b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:09.676515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9df932-c67f-4896-bf90-055921dd836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:09.676944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9df932-c67f-4896-bf90-055921dd836b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:09.677947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9df932-c67f-4896-bf90-055921dd836b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:09.681845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9df932-c67f-4896-bf90-055921dd836b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:09.737133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 863/1713] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:09 2022] POST /identity/v3/users => generated 290 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:09.741088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9df932-c67f-4896-bf90-055921dd836b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:09.778387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 851/1714] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:09 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:09.781704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb4034-a765-47ce-9ef0-b94c3cbded2d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:09.786274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9df932-c67f-4896-bf90-055921dd836b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:10.183354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0e39f-4c35-4210-a4ea-7cd304e20985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:10.186115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e39f-4c35-4210-a4ea-7cd304e20985 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:10.186693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e39f-4c35-4210-a4ea-7cd304e20985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:10.187006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e39f-4c35-4210-a4ea-7cd304e20985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:10.188734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0e39f-4c35-4210-a4ea-7cd304e20985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:10.190701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0e39f-4c35-4210-a4ea-7cd304e20985 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:10.206618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 864/1715] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:10.213759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0bf56-628d-4e66-88fb-f4c018e50186 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:10.214089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0bf56-628d-4e66-88fb-f4c018e50186 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:10.214407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0bf56-628d-4e66-88fb-f4c018e50186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:10.237379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb4034-a765-47ce-9ef0-b94c3cbded2d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:10.248181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e4f0bf56-628d-4e66-88fb-f4c018e50186 None None] MFA Rules not processed for user `2a550d483fee4f84a11dccf72fc85dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:10.249531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e4f0bf56-628d-4e66-88fb-f4c018e50186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:10.277194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce5979-784e-4af8-854f-fd0ef1bc552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:10.277939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5979-784e-4af8-854f-fd0ef1bc552c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:10.278234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5979-784e-4af8-854f-fd0ef1bc552c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:10.278523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5979-784e-4af8-854f-fd0ef1bc552c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:10.290407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce5979-784e-4af8-854f-fd0ef1bc552c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:10.313232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce5979-784e-4af8-854f-fd0ef1bc552c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:10.371193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:10.461212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 865/1716] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:10.463337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0bf56-628d-4e66-88fb-f4c018e50186 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:10.472264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 852/1717] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:09 2022] POST /identity/v3/users => generated 292 bytes in 691 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:10.473235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce5979-784e-4af8-854f-fd0ef1bc552c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:10.474069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e4f0bf56-628d-4e66-88fb-f4c018e50186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:10.575201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce5979-784e-4af8-854f-fd0ef1bc552c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:10.624885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:10.628879 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926afde-fd45-48ee-983f-59a0140ecae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:10.635508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926afde-fd45-48ee-983f-59a0140ecae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:10.638401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926afde-fd45-48ee-983f-59a0140ecae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:10.641536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926afde-fd45-48ee-983f-59a0140ecae2 admin admin] PATH_INFO: `/v3/projects/3e79219fd5b64575821da28412f392e2/users/acac1abf6af14011a25137dc6893b300/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:10.756934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926afde-fd45-48ee-983f-59a0140ecae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e79219fd5b64575821da28412f392e2, user_id=acac1abf6af14011a25137dc6893b300, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:10.771069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926afde-fd45-48ee-983f-59a0140ecae2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:10.823593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 853/1718] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:10 2022] PUT /identity/v3/projects/3e79219fd5b64575821da28412f392e2/users/acac1abf6af14011a25137dc6893b300/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:10.834772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926afde-fd45-48ee-983f-59a0140ecae2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:10.922096 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0bf56-628d-4e66-88fb-f4c018e50186 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:11.157868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926afde-fd45-48ee-983f-59a0140ecae2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:11.178007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ac4ff-abba-40d5-964c-27caa0f2fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:11.178949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac4ff-abba-40d5-964c-27caa0f2fc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:11.179472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac4ff-abba-40d5-964c-27caa0f2fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:11.179974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac4ff-abba-40d5-964c-27caa0f2fc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:11.181691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ac4ff-abba-40d5-964c-27caa0f2fc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:11.186721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ac4ff-abba-40d5-964c-27caa0f2fc2f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:11.213706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:11.215166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:11.215476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:11.215737 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:11.220592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:11.229893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 854/1719] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:11.231194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ac4ff-abba-40d5-964c-27caa0f2fc2f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:11.261746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ac4ff-abba-40d5-964c-27caa0f2fc2f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:11.268233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf73848-5410-4410-80cf-ba2470d448f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:11.269295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73848-5410-4410-80cf-ba2470d448f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:11.269873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73848-5410-4410-80cf-ba2470d448f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:11.270529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73848-5410-4410-80cf-ba2470d448f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:11.272103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf73848-5410-4410-80cf-ba2470d448f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:11.274350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf73848-5410-4410-80cf-ba2470d448f1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:11.311816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 855/1720] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:11.316773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e9ad-a694-41b4-9415-cab7080620a0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:11.319554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e9ad-a694-41b4-9415-cab7080620a0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:11.319981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e9ad-a694-41b4-9415-cab7080620a0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:11.326849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 856/1721] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:00:11 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:00:11.327903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e9ad-a694-41b4-9415-cab7080620a0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:11.380635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e9ad-a694-41b4-9415-cab7080620a0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:11.408538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4517c1-23c6-4460-ab27-3a04eed1c2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:11.410436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4517c1-23c6-4460-ab27-3a04eed1c2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:11.411956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4517c1-23c6-4460-ab27-3a04eed1c2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:11.414022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4517c1-23c6-4460-ab27-3a04eed1c2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:11.417526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4517c1-23c6-4460-ab27-3a04eed1c2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:11.431148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4517c1-23c6-4460-ab27-3a04eed1c2f9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:11.478218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 857/1722] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:11.490653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4517c1-23c6-4460-ab27-3a04eed1c2f9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:11.527014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4517c1-23c6-4460-ab27-3a04eed1c2f9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:11.533849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:11.541168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:11.566352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cfce0-3b4a-4278-a7e9-95f8beb42294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:11.567389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfce0-3b4a-4278-a7e9-95f8beb42294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:11.567747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfce0-3b4a-4278-a7e9-95f8beb42294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:11.568112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfce0-3b4a-4278-a7e9-95f8beb42294 admin admin] PATH_INFO: `/v3/projects/3e79219fd5b64575821da28412f392e2/users/acac1abf6af14011a25137dc6893b300/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:11.573317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cfce0-3b4a-4278-a7e9-95f8beb42294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e79219fd5b64575821da28412f392e2, user_id=acac1abf6af14011a25137dc6893b300, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:11.576537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cfce0-3b4a-4278-a7e9-95f8beb42294 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:11.593208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 866/1723] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 1130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:11.604568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:11.658640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b794-0d60-4196-9eee-d19f21bf42c0 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:11.693633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 858/1724] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:11 2022] PUT /identity/v3/projects/3e79219fd5b64575821da28412f392e2/users/acac1abf6af14011a25137dc6893b300/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:11.707918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330993f3-a11a-4406-8a06-7ea95b5a6549 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:11.707918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330993f3-a11a-4406-8a06-7ea95b5a6549 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:11.708203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330993f3-a11a-4406-8a06-7ea95b5a6549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:11.901522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-330993f3-a11a-4406-8a06-7ea95b5a6549 None None] MFA Rules not processed for user `acac1abf6af14011a25137dc6893b300`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:11.903481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-330993f3-a11a-4406-8a06-7ea95b5a6549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:11.920295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41157f-ad91-4636-969c-e52aa8d16fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:11.921726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41157f-ad91-4636-969c-e52aa8d16fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:11.921838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41157f-ad91-4636-969c-e52aa8d16fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:11.922228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41157f-ad91-4636-969c-e52aa8d16fc9 admin admin] PATH_INFO: `/v3/projects/5407070d97074303bb66c7cb4945353e/users/a5a858de9663412bac1d6f597dd0352a/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:11.972461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:11.988882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41157f-ad91-4636-969c-e52aa8d16fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5407070d97074303bb66c7cb4945353e, user_id=a5a858de9663412bac1d6f597dd0352a, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:11.998632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41157f-ad91-4636-969c-e52aa8d16fc9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:12.084201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 867/1725] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:11 2022] PUT /identity/v3/projects/5407070d97074303bb66c7cb4945353e/users/a5a858de9663412bac1d6f597dd0352a/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:12.089700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbb719-f86e-422e-bf7d-c4ca027c336f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:12.090105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbb719-f86e-422e-bf7d-c4ca027c336f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:12.090401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbb719-f86e-422e-bf7d-c4ca027c336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:12.197498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3cbbb719-f86e-422e-bf7d-c4ca027c336f None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:12.200876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3cbbb719-f86e-422e-bf7d-c4ca027c336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:12.333861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 859/1726] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 627 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:12.339241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0ccf-33b0-45ff-b00f-358734744730 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:12.339546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0ccf-33b0-45ff-b00f-358734744730 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:12.340011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0ccf-33b0-45ff-b00f-358734744730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:12.402532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 868/1727] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:12.403430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbb719-f86e-422e-bf7d-c4ca027c336f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:12.437447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3cbbb719-f86e-422e-bf7d-c4ca027c336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:12.459352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c8ac0ccf-33b0-45ff-b00f-358734744730 None None] MFA Rules not processed for user `a5a858de9663412bac1d6f597dd0352a`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:12.460768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c8ac0ccf-33b0-45ff-b00f-358734744730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:12.466379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:12.597095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 860/1728] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:12.603077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac0ccf-33b0-45ff-b00f-358734744730 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:12.623417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbb719-f86e-422e-bf7d-c4ca027c336f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:12.634765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca88b3-0c13-403c-bb98-68dfabd15720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:12.635657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca88b3-0c13-403c-bb98-68dfabd15720 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:12.635987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca88b3-0c13-403c-bb98-68dfabd15720 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:12.636287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca88b3-0c13-403c-bb98-68dfabd15720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:12.750334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac0ccf-33b0-45ff-b00f-358734744730 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:12.765086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda896-9271-4e69-aeec-fb2d17ef2dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:12.765448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda896-9271-4e69-aeec-fb2d17ef2dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:12.765870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda896-9271-4e69-aeec-fb2d17ef2dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:12.766261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda896-9271-4e69-aeec-fb2d17ef2dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:12.767083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda896-9271-4e69-aeec-fb2d17ef2dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:12.769138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda896-9271-4e69-aeec-fb2d17ef2dcb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:12.826780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 861/1729] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:12 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:12.827858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda896-9271-4e69-aeec-fb2d17ef2dcb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:12.862672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca88b3-0c13-403c-bb98-68dfabd15720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:12.884724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca88b3-0c13-403c-bb98-68dfabd15720 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:12.942477 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 869/1730] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:12.967895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda896-9271-4e69-aeec-fb2d17ef2dcb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:12.986214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4a8f-6e8c-4c88-b572-29c1b1e5deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:12.988791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4a8f-6e8c-4c88-b572-29c1b1e5deaa admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:12.990346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4a8f-6e8c-4c88-b572-29c1b1e5deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:12.990650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4a8f-6e8c-4c88-b572-29c1b1e5deaa admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:12.991864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4a8f-6e8c-4c88-b572-29c1b1e5deaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:12.996109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4a8f-6e8c-4c88-b572-29c1b1e5deaa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:13.075228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4fdf-2c17-4548-83cd-488f6c96f640 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:13.075534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4fdf-2c17-4548-83cd-488f6c96f640 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:13.075884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4fdf-2c17-4548-83cd-488f6c96f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:13.077123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 862/1731] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:12 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:13.092400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4a8f-6e8c-4c88-b572-29c1b1e5deaa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:13.118710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2e5d4fdf-2c17-4548-83cd-488f6c96f640 None None] MFA Rules not processed for user `dcd4aeea3a094122a7c7c6944b96cb71`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:13.119008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4a8f-6e8c-4c88-b572-29c1b1e5deaa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:13.126302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2e5d4fdf-2c17-4548-83cd-488f6c96f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:13.144956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b48799-fd7b-4194-9674-f9763b182eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:13.148868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48799-fd7b-4194-9674-f9763b182eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:13.152186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48799-fd7b-4194-9674-f9763b182eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:13.152981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48799-fd7b-4194-9674-f9763b182eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:13.153829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b48799-fd7b-4194-9674-f9763b182eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:13.157065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b48799-fd7b-4194-9674-f9763b182eaa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:13.201125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 863/1732] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:13.202405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b48799-fd7b-4194-9674-f9763b182eaa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:13.230746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b48799-fd7b-4194-9674-f9763b182eaa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:13.246907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb8ae1-45b2-43e1-afd5-a870f0ae7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:13.247620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb8ae1-45b2-43e1-afd5-a870f0ae7b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:13.247918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb8ae1-45b2-43e1-afd5-a870f0ae7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:13.248209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb8ae1-45b2-43e1-afd5-a870f0ae7b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:13.248944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb8ae1-45b2-43e1-afd5-a870f0ae7b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:13.250628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb8ae1-45b2-43e1-afd5-a870f0ae7b8b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:13.257473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:13.271763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:13.294455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 864/1733] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:13.295259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb8ae1-45b2-43e1-afd5-a870f0ae7b8b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:13.324365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb8ae1-45b2-43e1-afd5-a870f0ae7b8b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:13.340568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4438b6-bb77-4cbb-9340-0fab340dbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:13.342392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4438b6-bb77-4cbb-9340-0fab340dbab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:13.342856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4438b6-bb77-4cbb-9340-0fab340dbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:13.343385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4438b6-bb77-4cbb-9340-0fab340dbab4 admin admin] PATH_INFO: `/v3/projects/5cea3386d0be4ea0b276fe9c64c787c3/users/baad1d6dc41140c3a3ac2512ba3e7872/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:13.383596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4438b6-bb77-4cbb-9340-0fab340dbab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cea3386d0be4ea0b276fe9c64c787c3, user_id=baad1d6dc41140c3a3ac2512ba3e7872, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:13.386955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4438b6-bb77-4cbb-9340-0fab340dbab4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:13.425662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 865/1734] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:13 2022] PUT /identity/v3/projects/5cea3386d0be4ea0b276fe9c64c787c3/users/baad1d6dc41140c3a3ac2512ba3e7872/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:13.427277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ffa5-a044-44f5-9617-3d5a818df1fb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:13.430131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ffa5-a044-44f5-9617-3d5a818df1fb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:13.430627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ffa5-a044-44f5-9617-3d5a818df1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:13.441379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 870/1735] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:13.503720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4fdf-2c17-4548-83cd-488f6c96f640 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:13.505217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2e5d4fdf-2c17-4548-83cd-488f6c96f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:13.511824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-be52ffa5-a044-44f5-9617-3d5a818df1fb None None] MFA Rules not processed for user `baad1d6dc41140c3a3ac2512ba3e7872`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:13.513405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be52ffa5-a044-44f5-9617-3d5a818df1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:13.671250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 866/1736] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:13.672348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52ffa5-a044-44f5-9617-3d5a818df1fb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:13.736591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4fdf-2c17-4548-83cd-488f6c96f640 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:13.863177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:13.863850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:13.864141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:13.864422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:13.878123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52ffa5-a044-44f5-9617-3d5a818df1fb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:13.888231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:13.890331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:13.893182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa802d-02f2-42a1-a709-96b33dcff5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:13.893905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa802d-02f2-42a1-a709-96b33dcff5ac admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:13.894198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa802d-02f2-42a1-a709-96b33dcff5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:13.894484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa802d-02f2-42a1-a709-96b33dcff5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:13.895202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa802d-02f2-42a1-a709-96b33dcff5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:13.897142 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa802d-02f2-42a1-a709-96b33dcff5ac admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:13.935688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 871/1737] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:13.959789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:13.970261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:13.977701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 867/1738] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:13 2022] POST /identity/v3/projects => generated 385 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:13.990133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa802d-02f2-42a1-a709-96b33dcff5ac admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:14.002168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431e109-77de-41fd-93ee-1bbb21d36a19 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:14.159145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:14.222880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa802d-02f2-42a1-a709-96b33dcff5ac admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:14.260287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:14.262504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:14.262820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:14.263170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] PATH_INFO: `/v3/projects/b43cb1afb4984bd69f861f78df3188b9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:14.268201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43cb1afb4984bd69f861f78df3188b9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:14.270337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:14.281414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a33b7c-c33a-4418-b2fc-3dc66a30f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:14.284567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33b7c-c33a-4418-b2fc-3dc66a30f1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:14.287077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33b7c-c33a-4418-b2fc-3dc66a30f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:14.289002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33b7c-c33a-4418-b2fc-3dc66a30f1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:14.290871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a33b7c-c33a-4418-b2fc-3dc66a30f1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:14.300729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:14.304702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a33b7c-c33a-4418-b2fc-3dc66a30f1d5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:14.410693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 868/1739] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:13 2022] POST /identity/v3/users => generated 299 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:14.410693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a33b7c-c33a-4418-b2fc-3dc66a30f1d5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:14.442652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a33b7c-c33a-4418-b2fc-3dc66a30f1d5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:14.476597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43cb1afb4984bd69f861f78df3188b9', 'request_id': 'req-df56bdf8-1fde-484d-811c-ff106a81f998'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:14.511043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43cb1afb4984bd69f861f78df3188b9', 'request_id': 'req-df56bdf8-1fde-484d-811c-ff106a81f998'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:14.536178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43cb1afb4984bd69f861f78df3188b9', 'request_id': 'req-df56bdf8-1fde-484d-811c-ff106a81f998'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:14.580581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] The token cache is being invalidate because project b43cb1afb4984bd69f861f78df3188b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:14.580900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:14.590466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-df56bdf8-1fde-484d-811c-ff106a81f998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:14.609613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 872/1740] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:13 2022] DELETE /identity/v3/projects/b43cb1afb4984bd69f861f78df3188b9 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:14.617169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871ae23-3330-42e2-943a-1a0db7b1035f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:14.618146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871ae23-3330-42e2-943a-1a0db7b1035f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:14.618840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871ae23-3330-42e2-943a-1a0db7b1035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:14.722763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6871ae23-3330-42e2-943a-1a0db7b1035f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:14.724466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:14.725176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:14.725468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:14.725783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:14.727597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:14.728302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6871ae23-3330-42e2-943a-1a0db7b1035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:14.736944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:14.768817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 869/1741] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:14.769209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:14.770526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 873/1742] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:14.771974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:14.788799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f307-3227-42ef-ab9f-aee04cd895a5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:14.788799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f307-3227-42ef-ab9f-aee04cd895a5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:14.788799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f307-3227-42ef-ab9f-aee04cd895a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:14.827980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b035c56-9dd5-4029-83c8-a7c83f3c37d0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:14.849795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac25ed-5c8f-4806-b8be-a8a8230b5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:14.850717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac25ed-5c8f-4806-b8be-a8a8230b5c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:14.851005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac25ed-5c8f-4806-b8be-a8a8230b5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:14.851495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac25ed-5c8f-4806-b8be-a8a8230b5c24 admin admin] PATH_INFO: `/v3/projects/855069a5bc4b4374b05f3360c27d5880/users/638543d674894039a2a05cf10d700218/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:14.872411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0751f307-3227-42ef-ab9f-aee04cd895a5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:14.876695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0751f307-3227-42ef-ab9f-aee04cd895a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:14.891169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac25ed-5c8f-4806-b8be-a8a8230b5c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855069a5bc4b4374b05f3360c27d5880, user_id=638543d674894039a2a05cf10d700218, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:14.894400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac25ed-5c8f-4806-b8be-a8a8230b5c24 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:14.927793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 874/1743] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:14.930842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 870/1744] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:14 2022] PUT /identity/v3/projects/855069a5bc4b4374b05f3360c27d5880/users/638543d674894039a2a05cf10d700218/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:14.931074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751f307-3227-42ef-ab9f-aee04cd895a5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:14.932122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac25ed-5c8f-4806-b8be-a8a8230b5c24 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:14.950336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751f307-3227-42ef-ab9f-aee04cd895a5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:15.133784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac25ed-5c8f-4806-b8be-a8a8230b5c24 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:15.142261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9cb7-18fb-41b8-9e3f-7d332ff6f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:15.143785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9cb7-18fb-41b8-9e3f-7d332ff6f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:15.144358 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9cb7-18fb-41b8-9e3f-7d332ff6f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:15.144922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9cb7-18fb-41b8-9e3f-7d332ff6f3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:15.146213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a9cb7-18fb-41b8-9e3f-7d332ff6f3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:15.148029 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a9cb7-18fb-41b8-9e3f-7d332ff6f3c4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:15.148819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:15.154360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:15.154821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:15.155080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:15.155888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:15.156209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:15.158217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:15.171846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 871/1745] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:15.174534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9cb7-18fb-41b8-9e3f-7d332ff6f3c4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:15.196544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9cb7-18fb-41b8-9e3f-7d332ff6f3c4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:15.198010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 875/1746] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:15.204291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:15.213635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e80e4-4722-4839-875e-a232dd0596bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:15.214867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e80e4-4722-4839-875e-a232dd0596bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:15.215493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e80e4-4722-4839-875e-a232dd0596bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:15.215967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e80e4-4722-4839-875e-a232dd0596bd admin admin] PATH_INFO: `/v3/projects/855069a5bc4b4374b05f3360c27d5880/users/638543d674894039a2a05cf10d700218/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:15.220107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e80e4-4722-4839-875e-a232dd0596bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=855069a5bc4b4374b05f3360c27d5880, user_id=638543d674894039a2a05cf10d700218, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:15.223146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e80e4-4722-4839-875e-a232dd0596bd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:15.237021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912508-8c4c-43f8-aa2b-cbe5e6fb4a44 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:15.264894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 872/1747] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:15 2022] PUT /identity/v3/projects/855069a5bc4b4374b05f3360c27d5880/users/638543d674894039a2a05cf10d700218/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:15.267878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f63194-0046-4f7e-b7af-a234a44cd2f4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:15.268248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f63194-0046-4f7e-b7af-a234a44cd2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:15.268678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f63194-0046-4f7e-b7af-a234a44cd2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:15.404485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f3f63194-0046-4f7e-b7af-a234a44cd2f4 None None] MFA Rules not processed for user `638543d674894039a2a05cf10d700218`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:15.407166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f3f63194-0046-4f7e-b7af-a234a44cd2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:15.482303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:15.497011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99fddc-2edc-46e1-9589-b9cf27e1bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:15.497689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99fddc-2edc-46e1-9589-b9cf27e1bc8f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:15.497993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99fddc-2edc-46e1-9589-b9cf27e1bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:15.498321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99fddc-2edc-46e1-9589-b9cf27e1bc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:15.499040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99fddc-2edc-46e1-9589-b9cf27e1bc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:15.501073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99fddc-2edc-46e1-9589-b9cf27e1bc8f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:15.567100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:15.581201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 876/1748] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:15 2022] POST /identity/v3/projects => generated 383 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:15.582205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99fddc-2edc-46e1-9589-b9cf27e1bc8f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:15.635844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 873/1749] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:15.648621 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f63194-0046-4f7e-b7af-a234a44cd2f4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:15.650739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f3f63194-0046-4f7e-b7af-a234a44cd2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:15.754031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99fddc-2edc-46e1-9589-b9cf27e1bc8f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:15.770100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e57d-6b56-4206-93a3-b71f55250897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:15.770897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e57d-6b56-4206-93a3-b71f55250897 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:15.771413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e57d-6b56-4206-93a3-b71f55250897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:15.771961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e57d-6b56-4206-93a3-b71f55250897 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:15.772871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521e57d-6b56-4206-93a3-b71f55250897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:15.776045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521e57d-6b56-4206-93a3-b71f55250897 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:15.828243 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 877/1750] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:15 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:15.832475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e57d-6b56-4206-93a3-b71f55250897 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:15.854337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f63194-0046-4f7e-b7af-a234a44cd2f4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:15.860127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e57d-6b56-4206-93a3-b71f55250897 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:15.884065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff6f27-26c1-45d3-8c23-46292fc73cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:15.885191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff6f27-26c1-45d3-8c23-46292fc73cab admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:15.885619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff6f27-26c1-45d3-8c23-46292fc73cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:15.894061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff6f27-26c1-45d3-8c23-46292fc73cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:15.895082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff6f27-26c1-45d3-8c23-46292fc73cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:15.899918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff6f27-26c1-45d3-8c23-46292fc73cab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:15.947499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 878/1751] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:15.948619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff6f27-26c1-45d3-8c23-46292fc73cab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:15.985370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff6f27-26c1-45d3-8c23-46292fc73cab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:16.003877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731f0b-0d31-4745-b136-c44541d3e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:16.004894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731f0b-0d31-4745-b136-c44541d3e5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:16.005025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1affa22-5d5c-4bc8-bd9c-7fd7e0365753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:16.005529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731f0b-0d31-4745-b136-c44541d3e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:16.005654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1affa22-5d5c-4bc8-bd9c-7fd7e0365753 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:16.005952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1affa22-5d5c-4bc8-bd9c-7fd7e0365753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:16.006445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1affa22-5d5c-4bc8-bd9c-7fd7e0365753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:16.007691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731f0b-0d31-4745-b136-c44541d3e5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:16.012785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731f0b-0d31-4745-b136-c44541d3e5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:16.015304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731f0b-0d31-4745-b136-c44541d3e5a4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:16.053807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 879/1752] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:16.057838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731f0b-0d31-4745-b136-c44541d3e5a4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:16.099091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731f0b-0d31-4745-b136-c44541d3e5a4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:16.120126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b1dc-0b4d-46a6-9023-70e6996296db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:16.121181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b1dc-0b4d-46a6-9023-70e6996296db admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:16.121621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b1dc-0b4d-46a6-9023-70e6996296db admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:16.121932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b1dc-0b4d-46a6-9023-70e6996296db admin admin] PATH_INFO: `/v3/projects/d545cfd6cd004ea39d24f0246813a1cd/users/078828c01357458ea7481f2ba61f9d03/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:16.165652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1affa22-5d5c-4bc8-bd9c-7fd7e0365753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:16.167293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1affa22-5d5c-4bc8-bd9c-7fd7e0365753 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:16.186284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296b1dc-0b4d-46a6-9023-70e6996296db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d545cfd6cd004ea39d24f0246813a1cd, user_id=078828c01357458ea7481f2ba61f9d03, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:16.200195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 874/1753] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:16.200717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296b1dc-0b4d-46a6-9023-70e6996296db admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:16.229013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 880/1754] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:16 2022] PUT /identity/v3/projects/d545cfd6cd004ea39d24f0246813a1cd/users/078828c01357458ea7481f2ba61f9d03/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:16.240563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5295-e122-4f33-a3a8-f6c5c385695c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:16.240841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5295-e122-4f33-a3a8-f6c5c385695c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:16.241115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5295-e122-4f33-a3a8-f6c5c385695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:16.282837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-72bc5295-e122-4f33-a3a8-f6c5c385695c None None] MFA Rules not processed for user `078828c01357458ea7481f2ba61f9d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:16.284304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-72bc5295-e122-4f33-a3a8-f6c5c385695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:16.313513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:16.439397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b1dc-0b4d-46a6-9023-70e6996296db admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:16.451142 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 875/1755] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:16.519035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5295-e122-4f33-a3a8-f6c5c385695c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:16.521096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-72bc5295-e122-4f33-a3a8-f6c5c385695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:16.666129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5295-e122-4f33-a3a8-f6c5c385695c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:16.670207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b1dc-0b4d-46a6-9023-70e6996296db admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:16.672657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:16.674329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:16.674768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:16.675205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] PATH_INFO: `/v3/users/ac8084e2d11645d49494e4f75642bead` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:16.676874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8084e2d11645d49494e4f75642bead)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:16.679085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:16.683857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f8b7-64c8-4de6-a453-4816224f8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:16.684670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f8b7-64c8-4de6-a453-4816224f8dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:16.685057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f8b7-64c8-4de6-a453-4816224f8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:16.685856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f8b7-64c8-4de6-a453-4816224f8dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:16.687687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7f8b7-64c8-4de6-a453-4816224f8dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:16.690641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7f8b7-64c8-4de6-a453-4816224f8dc2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:16.757607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 881/1756] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:16 2022] POST /identity/v3/projects => generated 383 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:16.762563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f8b7-64c8-4de6-a453-4816224f8dc2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:16.798789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8084e2d11645d49494e4f75642bead'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:16.802919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8084e2d11645d49494e4f75642bead'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:16.830382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8084e2d11645d49494e4f75642bead'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:16.846416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8084e2d11645d49494e4f75642bead'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:16.847706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c0df6a6-b9dd-4f80-aa7c-3ac5f5c94049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8084e2d11645d49494e4f75642bead'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:16.867070 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:16.900247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 876/1757] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:16 2022] DELETE /identity/v3/users/ac8084e2d11645d49494e4f75642bead => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:16.904212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067942-95d8-4c63-8426-dc226579f43c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:16.904724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067942-95d8-4c63-8426-dc226579f43c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:16.905232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067942-95d8-4c63-8426-dc226579f43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:16.969092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-62067942-95d8-4c63-8426-dc226579f43c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:16.969092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-62067942-95d8-4c63-8426-dc226579f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:16.978600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f8b7-64c8-4de6-a453-4816224f8dc2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:17.084744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:17.170164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 877/1758] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:17.183181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067942-95d8-4c63-8426-dc226579f43c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:17.184708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-62067942-95d8-4c63-8426-dc226579f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:17.189744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:17.190472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:17.193242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:17.194453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:17.198131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:17.206171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:17.296035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067942-95d8-4c63-8426-dc226579f43c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:17.306838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 882/1759] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:16 2022] POST /identity/v3/users => generated 298 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:17.306838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:17.313733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:17.315000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df0c0e-579f-499b-8b4a-3540acd80ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:17.315700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0c0e-579f-499b-8b4a-3540acd80ded service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:17.315996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0c0e-579f-499b-8b4a-3540acd80ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:17.316286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0c0e-579f-499b-8b4a-3540acd80ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:17.355348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa968a2-746b-4707-984d-60a9939a2bb9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:17.367896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa959d-f07f-4c1d-a442-03344eb178da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:17.369144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa959d-f07f-4c1d-a442-03344eb178da admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:17.369850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa959d-f07f-4c1d-a442-03344eb178da admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:17.370340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa959d-f07f-4c1d-a442-03344eb178da admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:17.371103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa959d-f07f-4c1d-a442-03344eb178da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:17.372770 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa959d-f07f-4c1d-a442-03344eb178da admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:17.379093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df0c0e-579f-499b-8b4a-3540acd80ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:17.380581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df0c0e-579f-499b-8b4a-3540acd80ded service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:17.412236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 883/1760] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:17.414838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa959d-f07f-4c1d-a442-03344eb178da admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:17.442144 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 878/1761] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:17.452601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa959d-f07f-4c1d-a442-03344eb178da admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:17.475401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:17.476595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:17.476595 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:17.477506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] PATH_INFO: `/v3/projects/ddba16eaf8a0492b98b657c3fdc524c2/users/3de0256cf1ad4d6aab978f01eba97b23/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:17.522723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddba16eaf8a0492b98b657c3fdc524c2, user_id=3de0256cf1ad4d6aab978f01eba97b23, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:17.527680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:17.574628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 884/1762] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:17 2022] PUT /identity/v3/projects/ddba16eaf8a0492b98b657c3fdc524c2/users/3de0256cf1ad4d6aab978f01eba97b23/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:17.576351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df0c0e-579f-499b-8b4a-3540acd80ded service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:17.598370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df0c0e-579f-499b-8b4a-3540acd80ded service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:17.651635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:17.654306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:17.776410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d3de9-c7e1-4a85-b902-6c069f0b4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:17.777207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d3de9-c7e1-4a85-b902-6c069f0b4080 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:17.779460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d3de9-c7e1-4a85-b902-6c069f0b4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:17.781040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d3de9-c7e1-4a85-b902-6c069f0b4080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:17.781272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d3de9-c7e1-4a85-b902-6c069f0b4080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:17.784186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d3de9-c7e1-4a85-b902-6c069f0b4080 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:17.802229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 879/1763] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:17.806392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06cb27-ba64-45dc-a3e9-ec66b8c55610 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:17.807633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d3de9-c7e1-4a85-b902-6c069f0b4080 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:17.815621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:17.818847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:17.820275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:17.821706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:17.826750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:17.827730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d3de9-c7e1-4a85-b902-6c069f0b4080 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:17.839702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81c945-6c66-4638-9d94-499989b8fea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:17.840900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81c945-6c66-4638-9d94-499989b8fea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:17.841179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81c945-6c66-4638-9d94-499989b8fea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:17.841727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81c945-6c66-4638-9d94-499989b8fea6 admin admin] PATH_INFO: `/v3/projects/ddba16eaf8a0492b98b657c3fdc524c2/users/3de0256cf1ad4d6aab978f01eba97b23/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:17.845232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81c945-6c66-4638-9d94-499989b8fea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddba16eaf8a0492b98b657c3fdc524c2, user_id=3de0256cf1ad4d6aab978f01eba97b23, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:17.854275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81c945-6c66-4638-9d94-499989b8fea6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:17.885151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 880/1764] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:17 2022] PUT /identity/v3/projects/ddba16eaf8a0492b98b657c3fdc524c2/users/3de0256cf1ad4d6aab978f01eba97b23/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:17.895875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f351-87b7-44b8-b3b3-9d424eb505b9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:17.896175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f351-87b7-44b8-b3b3-9d424eb505b9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:17.896464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f351-87b7-44b8-b3b3-9d424eb505b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:17.953990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:17.982905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-35c9f351-87b7-44b8-b3b3-9d424eb505b9 None None] MFA Rules not processed for user `3de0256cf1ad4d6aab978f01eba97b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:17.984479 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-35c9f351-87b7-44b8-b3b3-9d424eb505b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:18.018628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:18.028961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:18.055946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 885/1765] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:18.112945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:18.190314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 881/1766] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:18.201619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:18.207973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:18.258904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026452-0aea-4924-8fc3-bf12c7ea0dd3 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:18.279239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9f351-87b7-44b8-b3b3-9d424eb505b9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:18.280796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-35c9f351-87b7-44b8-b3b3-9d424eb505b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:18.475698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236afd13-0bcf-4926-888f-c006c6a6a1f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:18.476406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afd13-0bcf-4926-888f-c006c6a6a1f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:18.476778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afd13-0bcf-4926-888f-c006c6a6a1f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:18.477259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afd13-0bcf-4926-888f-c006c6a6a1f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:18.510720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236afd13-0bcf-4926-888f-c006c6a6a1f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:18.512343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236afd13-0bcf-4926-888f-c006c6a6a1f1 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:18.544288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9f351-87b7-44b8-b3b3-9d424eb505b9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:18.555804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 886/1767] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:18.562343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:18.563253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:18.563540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:18.563818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] PATH_INFO: `/v3/projects/e2b4cdd4452d400c92673b7aeedf2b72` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:18.566362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b4cdd4452d400c92673b7aeedf2b72)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:18.568398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:18.728328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b4cdd4452d400c92673b7aeedf2b72', 'request_id': 'req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:18.747345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b4cdd4452d400c92673b7aeedf2b72', 'request_id': 'req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:18.768059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236afd13-0bcf-4926-888f-c006c6a6a1f1 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:18.776984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b4cdd4452d400c92673b7aeedf2b72', 'request_id': 'req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:18.782670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236afd13-0bcf-4926-888f-c006c6a6a1f1 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:18.805452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] The token cache is being invalidate because project e2b4cdd4452d400c92673b7aeedf2b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:18.810495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:18.812061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:18.818899 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 882/1768] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:18 2022] DELETE /identity/v3/projects/e2b4cdd4452d400c92673b7aeedf2b72 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:18.820094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:18.824794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:18.934063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:18.935972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:18.936469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:18.939636 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:18.946020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:19.062020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdd561-829e-4a6d-80a4-3e4b90c0bd35 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:19.069393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:19.071905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:19.072447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:19.073909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] PATH_INFO: `/v3/users/acac1abf6af14011a25137dc6893b300` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:19.076089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acac1abf6af14011a25137dc6893b300)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:19.078992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:19.114702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:19.157888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:19.159814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:19.193717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 887/1769] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:19.262099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acac1abf6af14011a25137dc6893b300'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:19.264053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acac1abf6af14011a25137dc6893b300'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:19.285690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acac1abf6af14011a25137dc6893b300'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:19.307975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acac1abf6af14011a25137dc6893b300'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:19.308920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5059c730-e684-4fe6-b6f0-99668477e20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acac1abf6af14011a25137dc6893b300'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:19.337278 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 883/1770] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:18 2022] DELETE /identity/v3/users/acac1abf6af14011a25137dc6893b300 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:20.913197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:20.935967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22912ca-315f-478f-a034-1abce9856ad4 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:21.020585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:21.059517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:21.060417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:21.060709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:21.060992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] PATH_INFO: `/v3/projects/3e79219fd5b64575821da28412f392e2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:21.062271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e79219fd5b64575821da28412f392e2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:21.064527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:21.188864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e79219fd5b64575821da28412f392e2', 'request_id': 'req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:21.208202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e79219fd5b64575821da28412f392e2', 'request_id': 'req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:21.216048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e79219fd5b64575821da28412f392e2', 'request_id': 'req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:21.239592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] The token cache is being invalidate because project 3e79219fd5b64575821da28412f392e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:21.239948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:21.244960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1d7ccd3-fb99-4f06-90b6-0d32aaa018de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:21.251533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ced9-644c-471a-a20f-b11e9773d366 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:21.252054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ced9-644c-471a-a20f-b11e9773d366 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:21.252130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ced9-644c-471a-a20f-b11e9773d366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:21.253780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 888/1771] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:20 2022] DELETE /identity/v3/projects/3e79219fd5b64575821da28412f392e2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:21.293721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-91a9ced9-644c-471a-a20f-b11e9773d366 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:21.295232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-91a9ced9-644c-471a-a20f-b11e9773d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:21.487740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 884/1772] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:21.492622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfe00e-6e5c-4349-ad95-1bf9d2573ad6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:21.493766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfe00e-6e5c-4349-ad95-1bf9d2573ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:21.498057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfe00e-6e5c-4349-ad95-1bf9d2573ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:21.559248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2fbfe00e-6e5c-4349-ad95-1bf9d2573ad6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:21.560653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2fbfe00e-6e5c-4349-ad95-1bf9d2573ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:21.593589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 889/1773] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:21.598512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9ced9-644c-471a-a20f-b11e9773d366 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:21.600536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381668c3-39ed-4336-8d3f-8c4600c0e517 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:21.600921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381668c3-39ed-4336-8d3f-8c4600c0e517 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:21.601298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381668c3-39ed-4336-8d3f-8c4600c0e517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:21.610841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9ced9-644c-471a-a20f-b11e9773d366 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:21.634937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:21.635891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:21.636333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:21.636767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:21.637711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:21.638869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:21.644208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:21.645249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-381668c3-39ed-4336-8d3f-8c4600c0e517 None None] MFA Rules not processed for user `80ffae178b294666b137bf69233eef46`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:21.646631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-381668c3-39ed-4336-8d3f-8c4600c0e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:21.673943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 885/1774] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:21.678969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:21.697517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e715-7aab-44d5-9768-085073fd22f9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:21.715053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52c806-fb66-4358-afec-f4c1bf7b8853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:21.716229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c806-fb66-4358-afec-f4c1bf7b8853 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:21.716673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c806-fb66-4358-afec-f4c1bf7b8853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:21.717109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c806-fb66-4358-afec-f4c1bf7b8853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:21.718019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52c806-fb66-4358-afec-f4c1bf7b8853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:21.720152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52c806-fb66-4358-afec-f4c1bf7b8853 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:21.786028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 886/1775] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:21 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:21.790272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52c806-fb66-4358-afec-f4c1bf7b8853 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:21.803332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 890/1776] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:21.954336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52c806-fb66-4358-afec-f4c1bf7b8853 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:21.970285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a61a81-1c39-499d-8e18-8fd2527bd4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:21.971342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a61a81-1c39-499d-8e18-8fd2527bd4af admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:21.971586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a61a81-1c39-499d-8e18-8fd2527bd4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:21.971850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a61a81-1c39-499d-8e18-8fd2527bd4af admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:21.972581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a61a81-1c39-499d-8e18-8fd2527bd4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:21.974589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a61a81-1c39-499d-8e18-8fd2527bd4af admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:21.995899 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:22.027580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 887/1777] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:21 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:22.032411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381668c3-39ed-4336-8d3f-8c4600c0e517 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:22.048796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381668c3-39ed-4336-8d3f-8c4600c0e517 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:22.072877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04a773-4113-49ec-b450-da9ae18a31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:22.073777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04a773-4113-49ec-b450-da9ae18a31c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.074503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04a773-4113-49ec-b450-da9ae18a31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.074855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04a773-4113-49ec-b450-da9ae18a31c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:22.075687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04a773-4113-49ec-b450-da9ae18a31c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:22.077439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04a773-4113-49ec-b450-da9ae18a31c5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:22.114222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 891/1778] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:22.114391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a61a81-1c39-499d-8e18-8fd2527bd4af admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:22.138607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a61a81-1c39-499d-8e18-8fd2527bd4af admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:22.153151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a83b8-adc5-4a5d-9dea-0db8cfc09620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:22.154168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a83b8-adc5-4a5d-9dea-0db8cfc09620 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.154664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a83b8-adc5-4a5d-9dea-0db8cfc09620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.155608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a83b8-adc5-4a5d-9dea-0db8cfc09620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:22.156560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a83b8-adc5-4a5d-9dea-0db8cfc09620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:22.162757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a83b8-adc5-4a5d-9dea-0db8cfc09620 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:22.202819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04a773-4113-49ec-b450-da9ae18a31c5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:22.214260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 888/1779] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:22.218597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04a773-4113-49ec-b450-da9ae18a31c5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:22.238696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:22.240379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.240720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.242750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] PATH_INFO: `/v3/projects/f316d01b5e9045c48facfe5ef30514e0/users/84799b63eca74452b463942a8331d044/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:22.271467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f316d01b5e9045c48facfe5ef30514e0, user_id=84799b63eca74452b463942a8331d044, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:22.275923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:22.308486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 892/1780] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:22 2022] PUT /identity/v3/projects/f316d01b5e9045c48facfe5ef30514e0/users/84799b63eca74452b463942a8331d044/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:22.319678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b560ea-5f4a-4b84-b800-e7bcea5bcf3d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.322321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b560ea-5f4a-4b84-b800-e7bcea5bcf3d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.323522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b560ea-5f4a-4b84-b800-e7bcea5bcf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:22.392459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a3b560ea-5f4a-4b84-b800-e7bcea5bcf3d None None] MFA Rules not processed for user `84799b63eca74452b463942a8331d044`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:22.393954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a3b560ea-5f4a-4b84-b800-e7bcea5bcf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:22.478253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:22.480355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:22.523898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 889/1781] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:22.524775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b560ea-5f4a-4b84-b800-e7bcea5bcf3d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:22.563049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:22.626752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b560ea-5f4a-4b84-b800-e7bcea5bcf3d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:22.645714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5893-86c9-4fa8-9131-6310c68166a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:22.646703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5893-86c9-4fa8-9131-6310c68166a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.647062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5893-86c9-4fa8-9131-6310c68166a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.647408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5893-86c9-4fa8-9131-6310c68166a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:22.648207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5893-86c9-4fa8-9131-6310c68166a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:22.650386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e940-b0c2-4005-9bfa-265f0d91737a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:22.650880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5893-86c9-4fa8-9131-6310c68166a6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:22.686882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:22.688858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.689575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.690365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] PATH_INFO: `/v3/users/078828c01357458ea7481f2ba61f9d03` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:22.699766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078828c01357458ea7481f2ba61f9d03)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:22.699985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 890/1782] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:22 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:22.701119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5893-86c9-4fa8-9131-6310c68166a6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:22.703970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:22.832672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:22.846809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5893-86c9-4fa8-9131-6310c68166a6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:22.856637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:22.862740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.863398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.863703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:22.864609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:22.868739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:22.876710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078828c01357458ea7481f2ba61f9d03'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:22.877531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078828c01357458ea7481f2ba61f9d03'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:22.892431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078828c01357458ea7481f2ba61f9d03'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:22.899797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 891/1783] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:22 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:22.904785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:22.906731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:22.922015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078828c01357458ea7481f2ba61f9d03'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:22.939445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc08c-ab8c-40db-b6ce-6b36964688bd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:22.943935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8a491a0-bc46-47d5-9098-fb242d0d9b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078828c01357458ea7481f2ba61f9d03'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:22.953980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54126764-eefd-49aa-b83d-76304a874bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:22.954835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54126764-eefd-49aa-b83d-76304a874bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.955909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54126764-eefd-49aa-b83d-76304a874bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.956228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54126764-eefd-49aa-b83d-76304a874bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:22.956984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54126764-eefd-49aa-b83d-76304a874bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:22.958214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 893/1784] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:22 2022] DELETE /identity/v3/users/078828c01357458ea7481f2ba61f9d03 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:22.964313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a635-13b6-4512-9da8-800881d3a829 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:22.966436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54126764-eefd-49aa-b83d-76304a874bfb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:22.973608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a635-13b6-4512-9da8-800881d3a829 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:22.977893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a635-13b6-4512-9da8-800881d3a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:23.000586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 892/1785] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:00:23.004466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54126764-eefd-49aa-b83d-76304a874bfb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:23.032327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54126764-eefd-49aa-b83d-76304a874bfb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:23.040723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9fb6a635-13b6-4512-9da8-800881d3a829 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:23.043138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9fb6a635-13b6-4512-9da8-800881d3a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:23.141591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 894/1786] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:23.172571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6a635-13b6-4512-9da8-800881d3a829 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:23.187583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9fb6a635-13b6-4512-9da8-800881d3a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:23.230489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2e77-d892-4906-8fbe-a5edd5647aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:23.231195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2e77-d892-4906-8fbe-a5edd5647aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:23.231487 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2e77-d892-4906-8fbe-a5edd5647aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:23.231772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2e77-d892-4906-8fbe-a5edd5647aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:23.233901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d2e77-d892-4906-8fbe-a5edd5647aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:23.235766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d2e77-d892-4906-8fbe-a5edd5647aa5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:23.265949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 893/1787] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:00:23.268416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2e77-d892-4906-8fbe-a5edd5647aa5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:23.283262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2e77-d892-4906-8fbe-a5edd5647aa5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:23.306299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9474f1-bcd7-4906-8fe6-4260011b246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:23.307223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9474f1-bcd7-4906-8fe6-4260011b246d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:23.307513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9474f1-bcd7-4906-8fe6-4260011b246d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:23.307955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9474f1-bcd7-4906-8fe6-4260011b246d admin admin] PATH_INFO: `/v3/projects/b8fb8dd9c1434466863ad905a79b1df1/users/b8a9fc574dd94f219a63ad7409dc5188/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:23.352680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9474f1-bcd7-4906-8fe6-4260011b246d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fb8dd9c1434466863ad905a79b1df1, user_id=b8a9fc574dd94f219a63ad7409dc5188, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:23.355736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6a635-13b6-4512-9da8-800881d3a829 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:23.370131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:23.370982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:23.371400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:23.371794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:23.374004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9474f1-bcd7-4906-8fe6-4260011b246d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:23.386078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:23.396446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:23.398300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:23.401177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 894/1788] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:23 2022] PUT /identity/v3/projects/b8fb8dd9c1434466863ad905a79b1df1/users/b8a9fc574dd94f219a63ad7409dc5188/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:23.411253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16761d-fc24-4c4c-94f8-570b7402af4c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:23.411553 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16761d-fc24-4c4c-94f8-570b7402af4c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:23.412607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16761d-fc24-4c4c-94f8-570b7402af4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:23.421892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 895/1789] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:23.463022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3b16761d-fc24-4c4c-94f8-570b7402af4c None None] MFA Rules not processed for user `b8a9fc574dd94f219a63ad7409dc5188`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:23.464367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3b16761d-fc24-4c4c-94f8-570b7402af4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:23.561762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:23.563746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:23.609373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 895/1790] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:23.613872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16761d-fc24-4c4c-94f8-570b7402af4c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:23.720996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:23.744424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398aa2-ad66-4c08-9d46-ea0d16c7d21c service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:23.759107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16761d-fc24-4c4c-94f8-570b7402af4c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:23.767188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184720a-a36e-4ada-ac08-906b6116aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:23.768045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184720a-a36e-4ada-ac08-906b6116aa05 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:23.768539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184720a-a36e-4ada-ac08-906b6116aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:23.768899 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184720a-a36e-4ada-ac08-906b6116aa05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:23.778760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184720a-a36e-4ada-ac08-906b6116aa05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:23.781050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184720a-a36e-4ada-ac08-906b6116aa05 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:23.834744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 896/1791] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:23 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:23.836911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816082a8-e522-4062-a8ee-f3d574a3e5f3 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:23.837460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816082a8-e522-4062-a8ee-f3d574a3e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:23.837962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816082a8-e522-4062-a8ee-f3d574a3e5f3 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:23.840039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 897/1792] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:00:23.841271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816082a8-e522-4062-a8ee-f3d574a3e5f3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:23.877911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b677b-0281-4f25-abc2-d082dc6db7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:23.878589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b677b-0281-4f25-abc2-d082dc6db7cb service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:23.878881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b677b-0281-4f25-abc2-d082dc6db7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:23.879167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b677b-0281-4f25-abc2-d082dc6db7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:23.881136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e69b677b-0281-4f25-abc2-d082dc6db7cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:24.004128 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816082a8-e522-4062-a8ee-f3d574a3e5f3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:24.024933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b677b-0281-4f25-abc2-d082dc6db7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:24.026820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b677b-0281-4f25-abc2-d082dc6db7cb service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:24.032849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75f845-60f2-43c7-915b-e17b7afc8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:24.036885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f845-60f2-43c7-915b-e17b7afc8e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.037375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f845-60f2-43c7-915b-e17b7afc8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.037871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75f845-60f2-43c7-915b-e17b7afc8e89 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.039635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75f845-60f2-43c7-915b-e17b7afc8e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:24.040776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 896/1793] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:24.043191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fdb73-fb73-4b20-a4e3-023b11b049f9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.043711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fdb73-fb73-4b20-a4e3-023b11b049f9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.044190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fdb73-fb73-4b20-a4e3-023b11b049f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.049271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75f845-60f2-43c7-915b-e17b7afc8e89 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:24.079528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e87fdb73-fb73-4b20-a4e3-023b11b049f9 None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:24.081671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e87fdb73-fb73-4b20-a4e3-023b11b049f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:24.098827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 898/1794] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:23 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:24.104472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259fe23-c546-4076-8db8-25d2a7e7b904 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.104920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259fe23-c546-4076-8db8-25d2a7e7b904 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.105319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259fe23-c546-4076-8db8-25d2a7e7b904 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.108925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 899/1795] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:00:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:00:24.112594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259fe23-c546-4076-8db8-25d2a7e7b904 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:24.143755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259fe23-c546-4076-8db8-25d2a7e7b904 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:24.157838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68d9a-8862-454d-bb98-c018ad81399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:24.158707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68d9a-8862-454d-bb98-c018ad81399f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.160727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68d9a-8862-454d-bb98-c018ad81399f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.161325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68d9a-8862-454d-bb98-c018ad81399f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.162384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68d9a-8862-454d-bb98-c018ad81399f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:24.167420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68d9a-8862-454d-bb98-c018ad81399f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:24.204759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 900/1796] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:24.206370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa4c9-6a02-47e9-a343-51e24170c0ab None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.206370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa4c9-6a02-47e9-a343-51e24170c0ab None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.206536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa4c9-6a02-47e9-a343-51e24170c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.220588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:24.253324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f22fa4c9-6a02-47e9-a343-51e24170c0ab None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:24.254748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f22fa4c9-6a02-47e9-a343-51e24170c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:24.265474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 897/1797] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:24.268883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fdb73-fb73-4b20-a4e3-023b11b049f9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:24.271867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 901/1798] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:24.309582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fdb73-fb73-4b20-a4e3-023b11b049f9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:24.326378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14007c42-e324-4bec-a7c7-810a21ed4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:24.336662 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007c42-e324-4bec-a7c7-810a21ed4462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.337505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007c42-e324-4bec-a7c7-810a21ed4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.338300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007c42-e324-4bec-a7c7-810a21ed4462 admin admin] PATH_INFO: `/v3/projects/2a0da39edb2a4fd29dd943251da22bbc/users/5656abc0c1ca4d8b985698daabe4bac5/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.427647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14007c42-e324-4bec-a7c7-810a21ed4462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0da39edb2a4fd29dd943251da22bbc, user_id=5656abc0c1ca4d8b985698daabe4bac5, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:24.434636 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14007c42-e324-4bec-a7c7-810a21ed4462 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:24.472699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 898/1799] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:24 2022] PUT /identity/v3/projects/2a0da39edb2a4fd29dd943251da22bbc/users/5656abc0c1ca4d8b985698daabe4bac5/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:24.474330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa4c9-6a02-47e9-a343-51e24170c0ab None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:24.488685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa4c9-6a02-47e9-a343-51e24170c0ab None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:24.609747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:24.610274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.610567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.610856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.611711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:24.613296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:24.636969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 902/1800] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:24.638173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14007c42-e324-4bec-a7c7-810a21ed4462 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:24.651212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:24.656807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14007c42-e324-4bec-a7c7-810a21ed4462 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:24.657661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:24.672965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aa594-3a65-48f3-9b47-f42bc5fca93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:24.674965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aa594-3a65-48f3-9b47-f42bc5fca93f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.676346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aa594-3a65-48f3-9b47-f42bc5fca93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.676752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aa594-3a65-48f3-9b47-f42bc5fca93f admin admin] PATH_INFO: `/v3/projects/2a0da39edb2a4fd29dd943251da22bbc/users/5656abc0c1ca4d8b985698daabe4bac5/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.682351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aa594-3a65-48f3-9b47-f42bc5fca93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0da39edb2a4fd29dd943251da22bbc, user_id=5656abc0c1ca4d8b985698daabe4bac5, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:24.687955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aa594-3a65-48f3-9b47-f42bc5fca93f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:24.719605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 899/1801] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:24 2022] PUT /identity/v3/projects/2a0da39edb2a4fd29dd943251da22bbc/users/5656abc0c1ca4d8b985698daabe4bac5/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:24.731928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c3d1-d89f-402b-abf4-7294c1930dd7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:24.732230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c3d1-d89f-402b-abf4-7294c1930dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:24.736369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c3d1-d89f-402b-abf4-7294c1930dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:24.740290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:24.814712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9891c3d1-d89f-402b-abf4-7294c1930dd7 None None] MFA Rules not processed for user `5656abc0c1ca4d8b985698daabe4bac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:24.819126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9891c3d1-d89f-402b-abf4-7294c1930dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:24.892864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986673b7-25f4-44cc-a99d-c2e4002aace1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:25.002003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 900/1802] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:25.003255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891c3d1-d89f-402b-abf4-7294c1930dd7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:25.005006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9891c3d1-d89f-402b-abf4-7294c1930dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:25.138458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:25.141827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:25.142273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:25.144311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:25.172857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891c3d1-d89f-402b-abf4-7294c1930dd7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:25.178610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:25.182345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:25.232210 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 903/1803] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:25.238932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebf624-784b-498f-b9a0-efbfcff94dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:25.240063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebf624-784b-498f-b9a0-efbfcff94dc4 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:25.240361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebf624-784b-498f-b9a0-efbfcff94dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:25.240648 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebf624-784b-498f-b9a0-efbfcff94dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:25.241462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:25.245442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:25.285869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebf624-784b-498f-b9a0-efbfcff94dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:25.287893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebf624-784b-498f-b9a0-efbfcff94dc4 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:25.347314 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 901/1804] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:25.509059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb879ab-7c76-437b-9203-b0479f9515be service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:25.533785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:25.535380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:25.536061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:25.536524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:25.558327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:25.564272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:25.600319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 904/1805] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:25.708965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebf624-784b-498f-b9a0-efbfcff94dc4 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:25.727556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebf624-784b-498f-b9a0-efbfcff94dc4 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:25.736904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:25.737610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:25.737910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:25.738200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:25.744138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:25.811171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:25.904905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:25.907035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:25.929270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 902/1806] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:26.472282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:26.474544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:26.591431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:26.608798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d84b-d6ef-4bcf-9a67-5a4f9895e5f0 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:26.614802 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:26.615645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:26.615941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:26.616226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] PATH_INFO: `/v3/projects/d545cfd6cd004ea39d24f0246813a1cd` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:26.618368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d545cfd6cd004ea39d24f0246813a1cd)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:26.621807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:26.754608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd545cfd6cd004ea39d24f0246813a1cd', 'request_id': 'req-dd564949-cc18-4655-8f32-2068a1f82c54'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:26.768679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd545cfd6cd004ea39d24f0246813a1cd', 'request_id': 'req-dd564949-cc18-4655-8f32-2068a1f82c54'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:26.778440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd545cfd6cd004ea39d24f0246813a1cd', 'request_id': 'req-dd564949-cc18-4655-8f32-2068a1f82c54'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:26.800998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] The token cache is being invalidate because project d545cfd6cd004ea39d24f0246813a1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:26.801303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:26.802166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:26.808619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 905/1807] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:26 2022] DELETE /identity/v3/projects/d545cfd6cd004ea39d24f0246813a1cd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:26.809861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:26.823994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9638-f145-4123-8807-b5ec2bdb1b72 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:26.931896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:26.935334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:26.939131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:26.939579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] PATH_INFO: `/v3/users/3de0256cf1ad4d6aab978f01eba97b23` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:26.946510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de0256cf1ad4d6aab978f01eba97b23)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:26.952370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:27.036008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de0256cf1ad4d6aab978f01eba97b23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.036816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de0256cf1ad4d6aab978f01eba97b23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.056155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de0256cf1ad4d6aab978f01eba97b23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.081791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de0256cf1ad4d6aab978f01eba97b23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.097522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d36ae9c7-87f5-4500-8fd5-7a6394e507a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de0256cf1ad4d6aab978f01eba97b23'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.109822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 903/1808] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:26 2022] DELETE /identity/v3/users/3de0256cf1ad4d6aab978f01eba97b23 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:27.598840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:27.604517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:27.621398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd564949-cc18-4655-8f32-2068a1f82c54 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:27.728443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:27.730316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:27.730594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:27.730878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] PATH_INFO: `/v3/users/a5a858de9663412bac1d6f597dd0352a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:27.734234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a858de9663412bac1d6f597dd0352a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:27.738660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:27.844714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a858de9663412bac1d6f597dd0352a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.845427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a858de9663412bac1d6f597dd0352a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.859119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a858de9663412bac1d6f597dd0352a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.877360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a858de9663412bac1d6f597dd0352a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.878741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a858de9663412bac1d6f597dd0352a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:27.941788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 906/1809] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:27 2022] DELETE /identity/v3/users/a5a858de9663412bac1d6f597dd0352a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:27.956440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a529a2-6516-4b46-b082-f8e0f90c0bbc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:27.956981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a529a2-6516-4b46-b082-f8e0f90c0bbc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:27.957235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a529a2-6516-4b46-b082-f8e0f90c0bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:28.001150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-44a529a2-6516-4b46-b082-f8e0f90c0bbc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:28.005469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-44a529a2-6516-4b46-b082-f8e0f90c0bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:28.118866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:28.151471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 904/1810] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:28.258900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:28.260456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:28.266844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:28.386921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74b5c-e1cf-499a-a5e2-2b282c190e66 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:28.394551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef2ca6-51d0-42bb-96df-3bff005c4e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:28.395862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2ca6-51d0-42bb-96df-3bff005c4e70 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:28.396482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2ca6-51d0-42bb-96df-3bff005c4e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:28.398022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2ca6-51d0-42bb-96df-3bff005c4e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:28.416704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef2ca6-51d0-42bb-96df-3bff005c4e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:28.417396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef2ca6-51d0-42bb-96df-3bff005c4e70 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:28.434295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 907/1811] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:28.736263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a529a2-6516-4b46-b082-f8e0f90c0bbc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:28.737751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-44a529a2-6516-4b46-b082-f8e0f90c0bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:28.750637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a529a2-6516-4b46-b082-f8e0f90c0bbc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:28.755581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:28.756464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:28.756756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:28.757041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] PATH_INFO: `/v3/projects/ddba16eaf8a0492b98b657c3fdc524c2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:28.759263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddba16eaf8a0492b98b657c3fdc524c2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:28.761237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:28.821538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddba16eaf8a0492b98b657c3fdc524c2', 'request_id': 'req-1970da43-61a6-4049-a2e9-59ef1993fb13'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:28.831432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddba16eaf8a0492b98b657c3fdc524c2', 'request_id': 'req-1970da43-61a6-4049-a2e9-59ef1993fb13'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:28.840474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddba16eaf8a0492b98b657c3fdc524c2', 'request_id': 'req-1970da43-61a6-4049-a2e9-59ef1993fb13'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:28.854801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] The token cache is being invalidate because project ddba16eaf8a0492b98b657c3fdc524c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:28.855112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:28.862561 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1970da43-61a6-4049-a2e9-59ef1993fb13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:28.866935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 905/1812] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:28 2022] DELETE /identity/v3/projects/ddba16eaf8a0492b98b657c3fdc524c2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:28.876286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5839f-0912-430a-b4e9-d8e7e2d7dd81 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:28.878588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5839f-0912-430a-b4e9-d8e7e2d7dd81 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:28.879033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5839f-0912-430a-b4e9-d8e7e2d7dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:28.911959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dde5839f-0912-430a-b4e9-d8e7e2d7dd81 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:28.913514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dde5839f-0912-430a-b4e9-d8e7e2d7dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:29.060703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce7bc-6a58-4697-8dd8-ec0a396707d7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.061633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce7bc-6a58-4697-8dd8-ec0a396707d7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.062153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce7bc-6a58-4697-8dd8-ec0a396707d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.069706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 908/1813] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:29.092744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-986ce7bc-6a58-4697-8dd8-ec0a396707d7 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:29.094243 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-986ce7bc-6a58-4697-8dd8-ec0a396707d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:29.113367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 906/1814] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:29.119833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5839f-0912-430a-b4e9-d8e7e2d7dd81 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.139688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5839f-0912-430a-b4e9-d8e7e2d7dd81 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.154790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.156361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.156695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.156980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.157774 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:29.158092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:29.160914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:29.177673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 909/1815] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:29.182969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ce7bc-6a58-4697-8dd8-ec0a396707d7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.197796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ce7bc-6a58-4697-8dd8-ec0a396707d7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.206068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b134c4-556f-4d58-bd75-fafedd2052a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.207668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b134c4-556f-4d58-bd75-fafedd2052a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.207932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b134c4-556f-4d58-bd75-fafedd2052a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.208305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b134c4-556f-4d58-bd75-fafedd2052a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.209216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b134c4-556f-4d58-bd75-fafedd2052a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:29.212374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b134c4-556f-4d58-bd75-fafedd2052a9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:29.281564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 907/1816] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:29 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:29.282836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.293823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fec64-ad75-4bff-8223-976ef0ed1d66 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.387009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3b40-91ba-48e0-b095-7ad827507f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.387811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3b40-91ba-48e0-b095-7ad827507f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.389397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3b40-91ba-48e0-b095-7ad827507f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.389869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3b40-91ba-48e0-b095-7ad827507f61 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.391945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b3b40-91ba-48e0-b095-7ad827507f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:29.397678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b3b40-91ba-48e0-b095-7ad827507f61 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:29.429841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 910/1817] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:29 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:29.434349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b134c4-556f-4d58-bd75-fafedd2052a9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.448514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b134c4-556f-4d58-bd75-fafedd2052a9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.455447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581eb28-dc3d-4bd7-9be2-328dea1cdda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.456254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581eb28-dc3d-4bd7-9be2-328dea1cdda7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.456575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581eb28-dc3d-4bd7-9be2-328dea1cdda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.456904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581eb28-dc3d-4bd7-9be2-328dea1cdda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.457809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581eb28-dc3d-4bd7-9be2-328dea1cdda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:29.459536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581eb28-dc3d-4bd7-9be2-328dea1cdda7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:29.477727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 908/1818] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:29.480781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3b40-91ba-48e0-b095-7ad827507f61 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.504424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3b40-91ba-48e0-b095-7ad827507f61 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.512740 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.513428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.513863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.514040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.514792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:29.516940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:29.535526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 911/1819] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:00:29.537001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581eb28-dc3d-4bd7-9be2-328dea1cdda7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.548129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581eb28-dc3d-4bd7-9be2-328dea1cdda7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.555207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b458b-3bcf-454e-b08a-02ed694e0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.556569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b458b-3bcf-454e-b08a-02ed694e0cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.557058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b458b-3bcf-454e-b08a-02ed694e0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.558508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b458b-3bcf-454e-b08a-02ed694e0cd6 admin admin] PATH_INFO: `/v3/projects/d9acff324d9d481f923d0a83d0e9a9fc/users/2f4249e315224cd389ea389c39def6ca/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.578338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b458b-3bcf-454e-b08a-02ed694e0cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9acff324d9d481f923d0a83d0e9a9fc, user_id=2f4249e315224cd389ea389c39def6ca, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:29.583560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b458b-3bcf-454e-b08a-02ed694e0cd6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:29.605076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 909/1820] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:29 2022] PUT /identity/v3/projects/d9acff324d9d481f923d0a83d0e9a9fc/users/2f4249e315224cd389ea389c39def6ca/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:29.609713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.612234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:29.615336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ea15-568b-4262-9536-b78ae82e3b9a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.615763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ea15-568b-4262-9536-b78ae82e3b9a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.616228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ea15-568b-4262-9536-b78ae82e3b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.633982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d95be-fefc-4825-b561-90af4c51c7c7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.649511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:29.672218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6440ea15-568b-4262-9536-b78ae82e3b9a None None] MFA Rules not processed for user `2f4249e315224cd389ea389c39def6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:29.673536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6440ea15-568b-4262-9536-b78ae82e3b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:29.714555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.715461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.715755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.716040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] PATH_INFO: `/v3/users/84799b63eca74452b463942a8331d044` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.717414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=84799b63eca74452b463942a8331d044)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:29.719532 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:29.766913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:29.777712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 910/1821] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:29.780471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440ea15-568b-4262-9536-b78ae82e3b9a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.783457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6440ea15-568b-4262-9536-b78ae82e3b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:29.796395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84799b63eca74452b463942a8331d044'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.797582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84799b63eca74452b463942a8331d044'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.801924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440ea15-568b-4262-9536-b78ae82e3b9a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.804751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84799b63eca74452b463942a8331d044'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.809448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.810632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.811001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.811322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] PATH_INFO: `/v3/projects/5407070d97074303bb66c7cb4945353e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.812827 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5407070d97074303bb66c7cb4945353e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:29.814178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84799b63eca74452b463942a8331d044'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.814932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:29.815249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84799b63eca74452b463942a8331d044'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.837053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 912/1822] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:29 2022] DELETE /identity/v3/users/84799b63eca74452b463942a8331d044 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:29.838486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:29.839836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:29.901890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5407070d97074303bb66c7cb4945353e', 'request_id': 'req-5d80b8c8-d84b-4911-aab1-3c9bfab17799'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.911353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5407070d97074303bb66c7cb4945353e', 'request_id': 'req-5d80b8c8-d84b-4911-aab1-3c9bfab17799'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.918858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397dd45-2506-4361-a9c9-e4f4e20421cd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:29.921798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5407070d97074303bb66c7cb4945353e', 'request_id': 'req-5d80b8c8-d84b-4911-aab1-3c9bfab17799'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.935395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] The token cache is being invalidate because project 5407070d97074303bb66c7cb4945353e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:29.935714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.936840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5d80b8c8-d84b-4911-aab1-3c9bfab17799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:29.938821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 911/1823] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:29 2022] DELETE /identity/v3/projects/5407070d97074303bb66c7cb4945353e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:29.942822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728ecae-8623-419c-bb20-0fdde480895b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.943864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728ecae-8623-419c-bb20-0fdde480895b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.943864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728ecae-8623-419c-bb20-0fdde480895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.959943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:29.964998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7728ecae-8623-419c-bb20-0fdde480895b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:29.966265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7728ecae-8623-419c-bb20-0fdde480895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:29.995957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:29.997042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:29.997533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:29.998050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:29.998996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:30.001305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:30.045847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 912/1824] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:30.047116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728ecae-8623-419c-bb20-0fdde480895b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:30.050689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 913/1825] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:29 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:30.051849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:30.052153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7728ecae-8623-419c-bb20-0fdde480895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:30.054165 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:30.065565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728ecae-8623-419c-bb20-0fdde480895b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:30.127173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:30.128604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:30.129083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:30.129590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] PATH_INFO: `/v3/users/baad1d6dc41140c3a3ac2512ba3e7872` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:30.131048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] RBAC: Authorizing `identity:delete_user(user_id=baad1d6dc41140c3a3ac2512ba3e7872)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:30.133312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:30.135931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b7bb6-aa92-4f35-bd91-bab5696cfad3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:30.141575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:30.142253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:30.142546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:30.142834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:30.143532 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:30.145518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:30.167387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:30.178297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 914/1826] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:30 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:30.179946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:30.183958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:30.213485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baad1d6dc41140c3a3ac2512ba3e7872'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:30.214598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baad1d6dc41140c3a3ac2512ba3e7872'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:30.224330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baad1d6dc41140c3a3ac2512ba3e7872'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:30.242552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baad1d6dc41140c3a3ac2512ba3e7872'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:30.251731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baad1d6dc41140c3a3ac2512ba3e7872'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:30.260368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 913/1827] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:30 2022] DELETE /identity/v3/users/baad1d6dc41140c3a3ac2512ba3e7872 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:30.263365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:30.263365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:30.267675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d8f65-cf98-42bd-beae-7a0087100bd9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:30.359817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:30.361534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:30.361903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:30.362503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:30.368053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:30.396739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a0872-6fe0-4a0d-b34e-2f45b387843e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:30.398697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:30.403351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:30.411094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4c28c-413e-43b9-a530-c826b4a67176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:30.411094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c28c-413e-43b9-a530-c826b4a67176 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:30.411094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c28c-413e-43b9-a530-c826b4a67176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:30.411402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c28c-413e-43b9-a530-c826b4a67176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:30.412557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4c28c-413e-43b9-a530-c826b4a67176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:30.417235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4c28c-413e-43b9-a530-c826b4a67176 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:30.442977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 915/1828] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:30.450978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 914/1829] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:30.454271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:30.479004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e5f5-83d8-4300-88b9-e4d5cc5345af service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:30.484546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43593321-af18-46a8-83ec-43f6da7aee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:30.485462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593321-af18-46a8-83ec-43f6da7aee37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:30.485786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593321-af18-46a8-83ec-43f6da7aee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:30.486073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43593321-af18-46a8-83ec-43f6da7aee37 admin admin] PATH_INFO: `/v3/projects/bad45f94024e4020984c2d13d3cfc848/users/a6052eaeeff84bfda223ac6f67b85513/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:30.499552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:30.511995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43593321-af18-46a8-83ec-43f6da7aee37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad45f94024e4020984c2d13d3cfc848, user_id=a6052eaeeff84bfda223ac6f67b85513, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:30.515489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43593321-af18-46a8-83ec-43f6da7aee37 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:30.538817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 916/1830] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:30 2022] PUT /identity/v3/projects/bad45f94024e4020984c2d13d3cfc848/users/a6052eaeeff84bfda223ac6f67b85513/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:30.543393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4c28c-413e-43b9-a530-c826b4a67176 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:30.557585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4c28c-413e-43b9-a530-c826b4a67176 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:30.651637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed2d26-088a-480c-82e5-5c5a5075f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:30.652172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2d26-088a-480c-82e5-5c5a5075f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:30.652462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2d26-088a-480c-82e5-5c5a5075f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:30.652796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2d26-088a-480c-82e5-5c5a5075f0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:30.653592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed2d26-088a-480c-82e5-5c5a5075f0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:30.655232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed2d26-088a-480c-82e5-5c5a5075f0cb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:30.668739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 915/1831] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:30.675064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43593321-af18-46a8-83ec-43f6da7aee37 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:30.691947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43593321-af18-46a8-83ec-43f6da7aee37 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:30.701213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:30.703036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:30.703375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:30.703712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] PATH_INFO: `/v3/projects/bad45f94024e4020984c2d13d3cfc848/users/a6052eaeeff84bfda223ac6f67b85513/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:30.707663 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad45f94024e4020984c2d13d3cfc848, user_id=a6052eaeeff84bfda223ac6f67b85513, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:30.711629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:30.727916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 917/1832] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:30 2022] PUT /identity/v3/projects/bad45f94024e4020984c2d13d3cfc848/users/a6052eaeeff84bfda223ac6f67b85513/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:30.742700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac6c5-b8e9-4ce9-ba6d-6a95545f3e9f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:30.743165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac6c5-b8e9-4ce9-ba6d-6a95545f3e9f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:30.743839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac6c5-b8e9-4ce9-ba6d-6a95545f3e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:30.808619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-537ac6c5-b8e9-4ce9-ba6d-6a95545f3e9f None None] MFA Rules not processed for user `a6052eaeeff84bfda223ac6f67b85513`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:30.809913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-537ac6c5-b8e9-4ce9-ba6d-6a95545f3e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:30.842061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:30.921274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 916/1833] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:30.936864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:30.939372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:31.009629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20117454-cc5c-4b26-9bbe-ac1f27901896 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:31.013257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:31.013948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:31.014239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:31.014810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:31.024513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:31.026002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:31.037510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 918/1834] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:31.083884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ac6c5-b8e9-4ce9-ba6d-6a95545f3e9f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:31.088738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-537ac6c5-b8e9-4ce9-ba6d-6a95545f3e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:31.125709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:31.127439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:31.196394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ac6c5-b8e9-4ce9-ba6d-6a95545f3e9f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:31.217425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6333-e3e2-4899-8336-814ac2222c90 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:31.224664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:31.224664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:31.224664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:31.224664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] PATH_INFO: `/v3/projects/5cea3386d0be4ea0b276fe9c64c787c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:31.224954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cea3386d0be4ea0b276fe9c64c787c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:31.226585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:31.227949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:31.229378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:31.229710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:31.229999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] PATH_INFO: `/v3/projects/f316d01b5e9045c48facfe5ef30514e0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:31.231856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f316d01b5e9045c48facfe5ef30514e0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:31.234395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:31.314886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f316d01b5e9045c48facfe5ef30514e0', 'request_id': 'req-16c015b9-a92c-4320-a67e-c481ab2ded6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.324644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f316d01b5e9045c48facfe5ef30514e0', 'request_id': 'req-16c015b9-a92c-4320-a67e-c481ab2ded6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.334379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cea3386d0be4ea0b276fe9c64c787c3', 'request_id': 'req-2983d871-5e50-41c2-afa5-e071231fa906'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.348161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f316d01b5e9045c48facfe5ef30514e0', 'request_id': 'req-16c015b9-a92c-4320-a67e-c481ab2ded6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.361445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cea3386d0be4ea0b276fe9c64c787c3', 'request_id': 'req-2983d871-5e50-41c2-afa5-e071231fa906'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.377228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cea3386d0be4ea0b276fe9c64c787c3', 'request_id': 'req-2983d871-5e50-41c2-afa5-e071231fa906'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.379507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] The token cache is being invalidate because project f316d01b5e9045c48facfe5ef30514e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:31.379811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.380496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.382433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 919/1835] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:31 2022] DELETE /identity/v3/projects/f316d01b5e9045c48facfe5ef30514e0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:31.386618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:31.388175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:31.401170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:31.410332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] The token cache is being invalidate because project 5cea3386d0be4ea0b276fe9c64c787c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:31.410621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.411301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.419280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 917/1836] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:31 2022] DELETE /identity/v3/projects/5cea3386d0be4ea0b276fe9c64c787c3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:31.423993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:31.426680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:31.546494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:31.562053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c015b9-a92c-4320-a67e-c481ab2ded6b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:31.569247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:31.571546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:31.571790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:31.573649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] PATH_INFO: `/v3/users/b8a9fc574dd94f219a63ad7409dc5188` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:31.577169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983d871-5e50-41c2-afa5-e071231fa906 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:31.580653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a9fc574dd94f219a63ad7409dc5188)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:31.583372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:31.595766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:31.597440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:31.598619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:31.598932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] PATH_INFO: `/v3/users/638543d674894039a2a05cf10d700218` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:31.600781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] RBAC: Authorizing `identity:delete_user(user_id=638543d674894039a2a05cf10d700218)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:31.605099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:31.672930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a9fc574dd94f219a63ad7409dc5188'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.673904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a9fc574dd94f219a63ad7409dc5188'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.683169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a9fc574dd94f219a63ad7409dc5188'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.692635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a9fc574dd94f219a63ad7409dc5188'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.693414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a9fc574dd94f219a63ad7409dc5188'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.717919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 920/1837] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:31 2022] DELETE /identity/v3/users/b8a9fc574dd94f219a63ad7409dc5188 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:31.718911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:31.722091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:31.723050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638543d674894039a2a05cf10d700218'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.724021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638543d674894039a2a05cf10d700218'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.738209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638543d674894039a2a05cf10d700218'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.762497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638543d674894039a2a05cf10d700218'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.775014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9623b278-8792-4ca8-8fe4-ddd40f9c140a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638543d674894039a2a05cf10d700218'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:31.788797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 918/1838] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:31 2022] DELETE /identity/v3/users/638543d674894039a2a05cf10d700218 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:31.832798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bfd2-3806-4415-876e-e6137083b106 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:31.879480 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:31.927259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:31.928445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:31.928874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:31.929932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] PATH_INFO: `/v3/users/2f4249e315224cd389ea389c39def6ca` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:31.931843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4249e315224cd389ea389c39def6ca)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:31.935071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:32.013521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4249e315224cd389ea389c39def6ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.015270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4249e315224cd389ea389c39def6ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.027488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4249e315224cd389ea389c39def6ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.042761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4249e315224cd389ea389c39def6ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.043935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4249e315224cd389ea389c39def6ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.072114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 921/1839] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:31 2022] DELETE /identity/v3/users/2f4249e315224cd389ea389c39def6ca => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:32.079134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693dd37-ea71-4265-87fb-f05185520976 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:32.079821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693dd37-ea71-4265-87fb-f05185520976 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:32.079821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693dd37-ea71-4265-87fb-f05185520976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:32.099382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3693dd37-ea71-4265-87fb-f05185520976 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:32.101152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3693dd37-ea71-4265-87fb-f05185520976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:32.193504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 919/1840] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:32.211453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:32.212986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:32.282930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242d4b2-77dd-46f7-aa24-590d35623965 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:32.288180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:32.289472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:32.289898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:32.290192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:32.302630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:32.305235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:32.319751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 922/1841] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:32.542357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693dd37-ea71-4265-87fb-f05185520976 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:32.544196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3693dd37-ea71-4265-87fb-f05185520976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:32.563047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693dd37-ea71-4265-87fb-f05185520976 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:32.578967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:32.580167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:32.580690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:32.582639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] PATH_INFO: `/v3/projects/b8fb8dd9c1434466863ad905a79b1df1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:32.589317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8fb8dd9c1434466863ad905a79b1df1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:32.606059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:32.675099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:32.677162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:32.692449 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7bde-9fa9-4852-b69a-4963b94de0c4 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:32.711653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8fb8dd9c1434466863ad905a79b1df1', 'request_id': 'req-9430dc14-96fe-46fe-8094-baeb779ca61d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.728521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8fb8dd9c1434466863ad905a79b1df1', 'request_id': 'req-9430dc14-96fe-46fe-8094-baeb779ca61d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.739798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:32.747545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8fb8dd9c1434466863ad905a79b1df1', 'request_id': 'req-9430dc14-96fe-46fe-8094-baeb779ca61d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.794265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] The token cache is being invalidate because project b8fb8dd9c1434466863ad905a79b1df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:32.794265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.795200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.797441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 920/1842] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:32 2022] DELETE /identity/v3/projects/b8fb8dd9c1434466863ad905a79b1df1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:32.801723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:32.803453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:32.808697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:32.841783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:32.843217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:32.844192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:32.845034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] PATH_INFO: `/v3/projects/855069a5bc4b4374b05f3360c27d5880` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:32.847057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] RBAC: Authorizing `identity:delete_project(project_id=855069a5bc4b4374b05f3360c27d5880)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:32.855409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:32.935832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430dc14-96fe-46fe-8094-baeb779ca61d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:32.955554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855069a5bc4b4374b05f3360c27d5880', 'request_id': 'req-beb03c0b-a147-4c40-ac8d-4838e1db851f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.967533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855069a5bc4b4374b05f3360c27d5880', 'request_id': 'req-beb03c0b-a147-4c40-ac8d-4838e1db851f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.974840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855069a5bc4b4374b05f3360c27d5880', 'request_id': 'req-beb03c0b-a147-4c40-ac8d-4838e1db851f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.990630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] The token cache is being invalidate because project 855069a5bc4b4374b05f3360c27d5880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:32.990930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.992270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:32.995732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 923/1843] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:32 2022] DELETE /identity/v3/projects/855069a5bc4b4374b05f3360c27d5880 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:32.996725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:32.999267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:33.057255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.058223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.063980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.064448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] PATH_INFO: `/v3/users/5656abc0c1ca4d8b985698daabe4bac5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.066246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5656abc0c1ca4d8b985698daabe4bac5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.068239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.111743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03c0b-a147-4c40-ac8d-4838e1db851f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.118291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.121980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.121980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.121980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] PATH_INFO: `/v3/projects/d9acff324d9d481f923d0a83d0e9a9fc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.121980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9acff324d9d481f923d0a83d0e9a9fc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.124793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.185686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5656abc0c1ca4d8b985698daabe4bac5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.186617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5656abc0c1ca4d8b985698daabe4bac5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.200650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5656abc0c1ca4d8b985698daabe4bac5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.208376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9acff324d9d481f923d0a83d0e9a9fc', 'request_id': 'req-0253a7ab-dd62-4640-a826-6ce2f47b736c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.222514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9acff324d9d481f923d0a83d0e9a9fc', 'request_id': 'req-0253a7ab-dd62-4640-a826-6ce2f47b736c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.224071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5656abc0c1ca4d8b985698daabe4bac5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.233336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9acff324d9d481f923d0a83d0e9a9fc', 'request_id': 'req-0253a7ab-dd62-4640-a826-6ce2f47b736c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.245415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5656abc0c1ca4d8b985698daabe4bac5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.249180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] The token cache is being invalidate because project d9acff324d9d481f923d0a83d0e9a9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:33.249735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.250720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253a7ab-dd62-4640-a826-6ce2f47b736c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.252523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 924/1844] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:32 2022] DELETE /identity/v3/projects/d9acff324d9d481f923d0a83d0e9a9fc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:33.253755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 921/1845] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:32 2022] DELETE /identity/v3/users/5656abc0c1ca4d8b985698daabe4bac5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:33.254340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbadd1-4967-41e2-8dc7-08fc7ebca935 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.254641 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbadd1-4967-41e2-8dc7-08fc7ebca935 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.254929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbadd1-4967-41e2-8dc7-08fc7ebca935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.256418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:33.259177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:33.281599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:33.283933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-adbbadd1-4967-41e2-8dc7-08fc7ebca935 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:33.285701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-adbbadd1-4967-41e2-8dc7-08fc7ebca935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:33.302566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:33.369702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff6279-4cbb-4840-8f39-f6ad2d9bf731 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.379200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.380883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.381178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.381464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] PATH_INFO: `/v3/users/a6052eaeeff84bfda223ac6f67b85513` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.382957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6052eaeeff84bfda223ac6f67b85513)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.386542 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.401590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 925/1846] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:33.410422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7350be7-5c0c-4f35-8047-8e7f2a5302b3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.410933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7350be7-5c0c-4f35-8047-8e7f2a5302b3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.411354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7350be7-5c0c-4f35-8047-8e7f2a5302b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.443595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d7350be7-5c0c-4f35-8047-8e7f2a5302b3 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:33.445453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d7350be7-5c0c-4f35-8047-8e7f2a5302b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:33.462797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 926/1847] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:33.465707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7350be7-5c0c-4f35-8047-8e7f2a5302b3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:33.481239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7350be7-5c0c-4f35-8047-8e7f2a5302b3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.490667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.492779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.493264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.494020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.495041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:33.495563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.498815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.519766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6052eaeeff84bfda223ac6f67b85513'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.520820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6052eaeeff84bfda223ac6f67b85513'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.526408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 927/1848] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:33.527587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:33.532162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:33.536489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6052eaeeff84bfda223ac6f67b85513'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.555397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb331352-865a-41e7-84e6-d4e1316a1805 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.562506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.563616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.564826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.565534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.567416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6052eaeeff84bfda223ac6f67b85513'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.567687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.572151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.587850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6052eaeeff84bfda223ac6f67b85513'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.600464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 922/1849] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:33 2022] DELETE /identity/v3/users/a6052eaeeff84bfda223ac6f67b85513 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:33.615206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 928/1850] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:33 2022] POST /identity/v3/projects => generated 409 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:33.616494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:33.708393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1cd9a-21c4-46a2-9728-533ff0a3941d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.734686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:33.737303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:33.767206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:33.803393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ba2cc-3f1b-4812-87ae-99a7b5d54814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.803393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba2cc-3f1b-4812-87ae-99a7b5d54814 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.803393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba2cc-3f1b-4812-87ae-99a7b5d54814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.803393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba2cc-3f1b-4812-87ae-99a7b5d54814 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.803750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ba2cc-3f1b-4812-87ae-99a7b5d54814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.805234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ba2cc-3f1b-4812-87ae-99a7b5d54814 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.831301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 923/1851] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:33 2022] POST /identity/v3/users => generated 305 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:33.836167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ba2cc-3f1b-4812-87ae-99a7b5d54814 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:33.847083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ba2cc-3f1b-4812-87ae-99a7b5d54814 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.854204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a96d-0c7d-412c-9ac3-f82091a496f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.855470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a96d-0c7d-412c-9ac3-f82091a496f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.855871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a96d-0c7d-412c-9ac3-f82091a496f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.856040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a96d-0c7d-412c-9ac3-f82091a496f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.857110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14a96d-0c7d-412c-9ac3-f82091a496f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.858397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262c4ce-2e44-4227-b950-00c5fba1c875 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.858527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14a96d-0c7d-412c-9ac3-f82091a496f6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.864016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.865102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.865492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.866005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] PATH_INFO: `/v3/projects/2a0da39edb2a4fd29dd943251da22bbc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.867495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0da39edb2a4fd29dd943251da22bbc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.872927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 924/1852] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:33.873081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.873846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a96d-0c7d-412c-9ac3-f82091a496f6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:33.887602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a96d-0c7d-412c-9ac3-f82091a496f6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.892480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff8699-57ad-4ce8-a46b-5f03f44ac823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.893362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff8699-57ad-4ce8-a46b-5f03f44ac823 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.893754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff8699-57ad-4ce8-a46b-5f03f44ac823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.894110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff8699-57ad-4ce8-a46b-5f03f44ac823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.894837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff8699-57ad-4ce8-a46b-5f03f44ac823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:33.896483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff8699-57ad-4ce8-a46b-5f03f44ac823 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:33.913661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 925/1853] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:33.914547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff8699-57ad-4ce8-a46b-5f03f44ac823 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:33.924479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff8699-57ad-4ce8-a46b-5f03f44ac823 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:33.934684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0da39edb2a4fd29dd943251da22bbc', 'request_id': 'req-d827b96a-d1c7-49be-9b20-5aabe6ff8619'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.941160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0da39edb2a4fd29dd943251da22bbc', 'request_id': 'req-d827b96a-d1c7-49be-9b20-5aabe6ff8619'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.950767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0da39edb2a4fd29dd943251da22bbc', 'request_id': 'req-d827b96a-d1c7-49be-9b20-5aabe6ff8619'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.964633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] The token cache is being invalidate because project 2a0da39edb2a4fd29dd943251da22bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:33.964930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.965647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d827b96a-d1c7-49be-9b20-5aabe6ff8619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:33.972962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 929/1854] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:33 2022] DELETE /identity/v3/projects/2a0da39edb2a4fd29dd943251da22bbc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:33.974478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c76d0-1a30-46e8-894a-d694f83ee423 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.974774 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c76d0-1a30-46e8-894a-d694f83ee423 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.975063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c76d0-1a30-46e8-894a-d694f83ee423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:33.984722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:33.990116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8210e2-6a23-430f-bb02-59ccf12aea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:33.991145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8210e2-6a23-430f-bb02-59ccf12aea0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:33.991956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8210e2-6a23-430f-bb02-59ccf12aea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:33.992701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8210e2-6a23-430f-bb02-59ccf12aea0a admin admin] PATH_INFO: `/v3/projects/12f757b4c9ca40cf8a9227f931f30080/users/54029094e13245d1b94108f0c394a522/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.001931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-767c76d0-1a30-46e8-894a-d694f83ee423 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:34.005194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-767c76d0-1a30-46e8-894a-d694f83ee423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.014874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8210e2-6a23-430f-bb02-59ccf12aea0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f757b4c9ca40cf8a9227f931f30080, user_id=54029094e13245d1b94108f0c394a522, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.017937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8210e2-6a23-430f-bb02-59ccf12aea0a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.026476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 930/1855] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:34.029871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbec3e-8206-482f-8b09-3f380017a03a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.030378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbec3e-8206-482f-8b09-3f380017a03a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.030763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbec3e-8206-482f-8b09-3f380017a03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.052400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-79cbec3e-8206-482f-8b09-3f380017a03a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:34.053807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-79cbec3e-8206-482f-8b09-3f380017a03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.067347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 926/1856] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:33 2022] PUT /identity/v3/projects/12f757b4c9ca40cf8a9227f931f30080/users/54029094e13245d1b94108f0c394a522/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:34.069143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5226-5927-4506-8784-716cac2a20ee None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.071081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5226-5927-4506-8784-716cac2a20ee None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.073447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5226-5927-4506-8784-716cac2a20ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.146202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6cbf5226-5927-4506-8784-716cac2a20ee None None] MFA Rules not processed for user `54029094e13245d1b94108f0c394a522`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:34.150505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6cbf5226-5927-4506-8784-716cac2a20ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.185858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 931/1857] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:34.190868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbec3e-8206-482f-8b09-3f380017a03a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.192833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-79cbec3e-8206-482f-8b09-3f380017a03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.221282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbec3e-8206-482f-8b09-3f380017a03a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.236738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.237665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.237954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.238236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] PATH_INFO: `/v3/projects/bad45f94024e4020984c2d13d3cfc848` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.245139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad45f94024e4020984c2d13d3cfc848)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.247522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.275403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 927/1858] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:34.275403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf5226-5927-4506-8784-716cac2a20ee None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.286482 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf5226-5927-4506-8784-716cac2a20ee None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.295546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.306108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.306892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.307188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.308094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:34.308414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.310326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.324614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 928/1859] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:34.325522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.327229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.339376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad45f94024e4020984c2d13d3cfc848', 'request_id': 'req-7f3be1c9-1a78-4944-bd09-61813de9f009'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:34.341019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b03b-5fe5-4ec8-9622-33ef081dc7e6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.346767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad45f94024e4020984c2d13d3cfc848', 'request_id': 'req-7f3be1c9-1a78-4944-bd09-61813de9f009'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:34.349291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:34.359112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad45f94024e4020984c2d13d3cfc848', 'request_id': 'req-7f3be1c9-1a78-4944-bd09-61813de9f009'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:34.377787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] The token cache is being invalidate because project bad45f94024e4020984c2d13d3cfc848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:34.378260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:34.379764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:34.382375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 932/1860] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:34 2022] DELETE /identity/v3/projects/bad45f94024e4020984c2d13d3cfc848 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:34.383180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.390126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.426008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211ed52-3d53-428c-a4be-45cd41e8061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.426683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ed52-3d53-428c-a4be-45cd41e8061f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.426980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ed52-3d53-428c-a4be-45cd41e8061f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.427268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ed52-3d53-428c-a4be-45cd41e8061f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.427973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211ed52-3d53-428c-a4be-45cd41e8061f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.430187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211ed52-3d53-428c-a4be-45cd41e8061f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.466848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 929/1861] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/projects => generated 409 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:34.471140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195ee3-4cad-4016-a3a5-c6e05858c2bd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.471440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195ee3-4cad-4016-a3a5-c6e05858c2bd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.471732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195ee3-4cad-4016-a3a5-c6e05858c2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.486096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3be1c9-1a78-4944-bd09-61813de9f009 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.500578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bf195ee3-4cad-4016-a3a5-c6e05858c2bd None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:34.501883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf195ee3-4cad-4016-a3a5-c6e05858c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.527126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:34.570628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.571649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.572083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.572511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.573511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.576655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.619948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 933/1862] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/projects => generated 365 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:34.621396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.624536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.685668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 930/1863] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:34.685668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf195ee3-4cad-4016-a3a5-c6e05858c2bd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.701746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf195ee3-4cad-4016-a3a5-c6e05858c2bd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.725900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19a23-5439-44dc-b4fc-6a451da5e5c6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.732820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9c802-e15c-4b0d-a160-72a769b6d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.733767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c802-e15c-4b0d-a160-72a769b6d69a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.734199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c802-e15c-4b0d-a160-72a769b6d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.734931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c802-e15c-4b0d-a160-72a769b6d69a admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.736551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9c802-e15c-4b0d-a160-72a769b6d69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.738815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9c802-e15c-4b0d-a160-72a769b6d69a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.785440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 934/1864] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:34.786811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ec398-a77b-4448-b481-2be6d1127926 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.787109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ec398-a77b-4448-b481-2be6d1127926 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.787393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ec398-a77b-4448-b481-2be6d1127926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.825834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51cbea-0d98-4dde-81ef-57a3f83307a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.829206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51cbea-0d98-4dde-81ef-57a3f83307a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.829646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51cbea-0d98-4dde-81ef-57a3f83307a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.830079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51cbea-0d98-4dde-81ef-57a3f83307a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.830986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51cbea-0d98-4dde-81ef-57a3f83307a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.833206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51cbea-0d98-4dde-81ef-57a3f83307a1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.835345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d27ec398-a77b-4448-b481-2be6d1127926 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:34.837365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d27ec398-a77b-4448-b481-2be6d1127926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:34.847381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 935/1865] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:34.848402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ec398-a77b-4448-b481-2be6d1127926 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.862020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ec398-a77b-4448-b481-2be6d1127926 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.868264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb1e65-b8cb-48f8-b4e0-66261046719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.869503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb1e65-b8cb-48f8-b4e0-66261046719a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.870132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb1e65-b8cb-48f8-b4e0-66261046719a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.870566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb1e65-b8cb-48f8-b4e0-66261046719a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.871573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb1e65-b8cb-48f8-b4e0-66261046719a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.873720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb1e65-b8cb-48f8-b4e0-66261046719a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.874673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 931/1866] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:34.878755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51cbea-0d98-4dde-81ef-57a3f83307a1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.895353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 936/1867] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:34.895353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb1e65-b8cb-48f8-b4e0-66261046719a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.900874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51cbea-0d98-4dde-81ef-57a3f83307a1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.907980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb1e65-b8cb-48f8-b4e0-66261046719a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.908368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.910004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.910450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.910885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.911839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:34.912300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.914097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57cbd7-78ac-43ce-92a7-b1b499386c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.914816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57cbd7-78ac-43ce-92a7-b1b499386c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.915060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.915323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57cbd7-78ac-43ce-92a7-b1b499386c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.915870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57cbd7-78ac-43ce-92a7-b1b499386c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.916710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57cbd7-78ac-43ce-92a7-b1b499386c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.918939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57cbd7-78ac-43ce-92a7-b1b499386c9a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.932299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 932/1868] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:34.933234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.938557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 937/1869] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:34.939515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57cbd7-78ac-43ce-92a7-b1b499386c9a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:34.946614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5afec-276c-42b8-85d2-ed535770b509 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.952752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57cbd7-78ac-43ce-92a7-b1b499386c9a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:34.953200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbcdfb-10eb-465f-9f68-59a604e41bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.954935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcdfb-10eb-465f-9f68-59a604e41bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.955282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcdfb-10eb-465f-9f68-59a604e41bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.955641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcdfb-10eb-465f-9f68-59a604e41bf6 admin admin] PATH_INFO: `/v3/projects/f147f628d18b47fd877f17bc59eda036/users/828f90f57d0a4decad94a40bea8956f6/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.959481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af162a3-8284-46df-a57a-69f526f897d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:34.960852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af162a3-8284-46df-a57a-69f526f897d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:34.961365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af162a3-8284-46df-a57a-69f526f897d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:34.961959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af162a3-8284-46df-a57a-69f526f897d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:34.963352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af162a3-8284-46df-a57a-69f526f897d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.965365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af162a3-8284-46df-a57a-69f526f897d9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:34.971855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:34.978174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbcdfb-10eb-465f-9f68-59a604e41bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f147f628d18b47fd877f17bc59eda036, user_id=828f90f57d0a4decad94a40bea8956f6, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:34.981269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbcdfb-10eb-465f-9f68-59a604e41bf6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.000414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 933/1870] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:34 2022] PUT /identity/v3/projects/f147f628d18b47fd877f17bc59eda036/users/828f90f57d0a4decad94a40bea8956f6/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:35.004480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbcdfb-10eb-465f-9f68-59a604e41bf6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.005207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 938/1871] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:34 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:35.010068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af162a3-8284-46df-a57a-69f526f897d9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.080374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:35.098082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af162a3-8284-46df-a57a-69f526f897d9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.099297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbcdfb-10eb-465f-9f68-59a604e41bf6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.104056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355475-7049-482c-af6a-8dabf621101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.104940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355475-7049-482c-af6a-8dabf621101d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.105237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355475-7049-482c-af6a-8dabf621101d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.105341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5ec0b-17aa-4e7f-891f-18b761bfc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.105693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355475-7049-482c-af6a-8dabf621101d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.106312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5ec0b-17aa-4e7f-891f-18b761bfc249 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.106481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc355475-7049-482c-af6a-8dabf621101d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.107268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5ec0b-17aa-4e7f-891f-18b761bfc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.107268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5ec0b-17aa-4e7f-891f-18b761bfc249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.107861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5ec0b-17aa-4e7f-891f-18b761bfc249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.108686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc355475-7049-482c-af6a-8dabf621101d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.109877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5ec0b-17aa-4e7f-891f-18b761bfc249 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.123813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 939/1872] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:35.124729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355475-7049-482c-af6a-8dabf621101d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.128676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 934/1873] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:35.129635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5ec0b-17aa-4e7f-891f-18b761bfc249 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.139389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355475-7049-482c-af6a-8dabf621101d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.146128 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5ec0b-17aa-4e7f-891f-18b761bfc249 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.153003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d9201-6328-474b-ab2d-6bba87f3013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.154281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d9201-6328-474b-ab2d-6bba87f3013b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.155316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d9201-6328-474b-ab2d-6bba87f3013b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.155796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d9201-6328-474b-ab2d-6bba87f3013b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.156979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d9201-6328-474b-ab2d-6bba87f3013b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.160166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d9201-6328-474b-ab2d-6bba87f3013b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.161145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599fc09-0121-45c7-9133-f0b09569d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.162224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fc09-0121-45c7-9133-f0b09569d0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.163054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fc09-0121-45c7-9133-f0b09569d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.163545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fc09-0121-45c7-9133-f0b09569d0ce admin admin] PATH_INFO: `/v3/projects/f147f628d18b47fd877f17bc59eda036/users/828f90f57d0a4decad94a40bea8956f6/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.166838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599fc09-0121-45c7-9133-f0b09569d0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f147f628d18b47fd877f17bc59eda036, user_id=828f90f57d0a4decad94a40bea8956f6, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.170035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599fc09-0121-45c7-9133-f0b09569d0ce admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.184275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 935/1874] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:35 2022] PUT /identity/v3/projects/f147f628d18b47fd877f17bc59eda036/users/828f90f57d0a4decad94a40bea8956f6/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:35.187333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599fc09-0121-45c7-9133-f0b09569d0ce admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.195727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 940/1875] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:35 2022] POST /identity/v3/users => generated 289 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:35.197250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d9201-6328-474b-ab2d-6bba87f3013b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.208902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d9201-6328-474b-ab2d-6bba87f3013b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.292081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599fc09-0121-45c7-9133-f0b09569d0ce admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.299262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730258f-969f-4dc2-93b4-d8b1bfcf4d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.300178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730258f-969f-4dc2-93b4-d8b1bfcf4d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.300614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730258f-969f-4dc2-93b4-d8b1bfcf4d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.300904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730258f-969f-4dc2-93b4-d8b1bfcf4d46 admin admin] PATH_INFO: `/v3/projects/552dd4d2c61a436e943ecbaad79128f8/users/a89c1588c2c341898cff9df9cdcd606b/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.302855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979b058-f5da-4e2a-bbe5-ee2e97b4f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.303845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979b058-f5da-4e2a-bbe5-ee2e97b4f3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.304869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979b058-f5da-4e2a-bbe5-ee2e97b4f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.308226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979b058-f5da-4e2a-bbe5-ee2e97b4f3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.309323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979b058-f5da-4e2a-bbe5-ee2e97b4f3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.311532 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979b058-f5da-4e2a-bbe5-ee2e97b4f3dd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.323904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730258f-969f-4dc2-93b4-d8b1bfcf4d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552dd4d2c61a436e943ecbaad79128f8, user_id=a89c1588c2c341898cff9df9cdcd606b, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.326721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730258f-969f-4dc2-93b4-d8b1bfcf4d46 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.327371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 941/1876] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:35.328744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961873-d8ae-4e2e-ae0e-f5ada06a5efc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.329169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961873-d8ae-4e2e-ae0e-f5ada06a5efc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.329954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961873-d8ae-4e2e-ae0e-f5ada06a5efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.361583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 936/1877] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:35 2022] PUT /identity/v3/projects/552dd4d2c61a436e943ecbaad79128f8/users/a89c1588c2c341898cff9df9cdcd606b/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:35.361583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730258f-969f-4dc2-93b4-d8b1bfcf4d46 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.380426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c7961873-d8ae-4e2e-ae0e-f5ada06a5efc None None] MFA Rules not processed for user `828f90f57d0a4decad94a40bea8956f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:35.383818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c7961873-d8ae-4e2e-ae0e-f5ada06a5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:35.501691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:35.510588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730258f-969f-4dc2-93b4-d8b1bfcf4d46 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.521177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.522426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.523107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.523850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.525137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.536832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.544534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 942/1878] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:35.546559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7cbc5-b170-4196-86d4-6965bcd9d1ea None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.547003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7cbc5-b170-4196-86d4-6965bcd9d1ea None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.548494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7cbc5-b170-4196-86d4-6965bcd9d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.570577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 937/1879] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:35.571750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.579270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:35.608503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ecf7cbc5-b170-4196-86d4-6965bcd9d1ea None None] MFA Rules not processed for user `a89c1588c2c341898cff9df9cdcd606b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:35.610003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ecf7cbc5-b170-4196-86d4-6965bcd9d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:35.705179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:35.729143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61ae2-783c-43bc-9030-fa54b1e9db98 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.743755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb22c-2e3f-47ef-85e2-49d8c2e2b6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.744800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb22c-2e3f-47ef-85e2-49d8c2e2b6dc service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.745647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb22c-2e3f-47ef-85e2-49d8c2e2b6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.746156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb22c-2e3f-47ef-85e2-49d8c2e2b6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.766947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bb22c-2e3f-47ef-85e2-49d8c2e2b6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.768095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 943/1880] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:35.769074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7cbc5-b170-4196-86d4-6965bcd9d1ea None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.771059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bb22c-2e3f-47ef-85e2-49d8c2e2b6dc service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.792875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7cbc5-b170-4196-86d4-6965bcd9d1ea None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.812967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb7f8-13c9-4b7b-a89f-ce1bfd9b7ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.814075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb7f8-13c9-4b7b-a89f-ce1bfd9b7ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.814364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb7f8-13c9-4b7b-a89f-ce1bfd9b7ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.814645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb7f8-13c9-4b7b-a89f-ce1bfd9b7ff6 admin admin] PATH_INFO: `/v3/projects/e785e9fecbe344dea1556ecc08a4cf37/users/8033524eb8924495839e2efc1f9e92d2/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.821925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 938/1881] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:35 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:35.824810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb22c-2e3f-47ef-85e2-49d8c2e2b6dc service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:35.857833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb22c-2e3f-47ef-85e2-49d8c2e2b6dc service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:35.876071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25cfee-ea22-4a4d-ac2b-a981d139973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:35.877129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25cfee-ea22-4a4d-ac2b-a981d139973a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.877420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25cfee-ea22-4a4d-ac2b-a981d139973a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.878560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25cfee-ea22-4a4d-ac2b-a981d139973a admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.879533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25cfee-ea22-4a4d-ac2b-a981d139973a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.879781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aeb7f8-13c9-4b7b-a89f-ce1bfd9b7ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e785e9fecbe344dea1556ecc08a4cf37, user_id=8033524eb8924495839e2efc1f9e92d2, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:35.881905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25cfee-ea22-4a4d-ac2b-a981d139973a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.884578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aeb7f8-13c9-4b7b-a89f-ce1bfd9b7ff6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:35.920708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 944/1882] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:35 2022] PUT /identity/v3/projects/e785e9fecbe344dea1556ecc08a4cf37/users/8033524eb8924495839e2efc1f9e92d2/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:35.938758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 939/1883] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:35 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:35.942521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398063d3-6a29-4de2-bc55-70c52032e66d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:35.943090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398063d3-6a29-4de2-bc55-70c52032e66d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:35.943593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398063d3-6a29-4de2-bc55-70c52032e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:35.943906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25cfee-ea22-4a4d-ac2b-a981d139973a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:36.004916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-398063d3-6a29-4de2-bc55-70c52032e66d None None] MFA Rules not processed for user `8033524eb8924495839e2efc1f9e92d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:36.006686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-398063d3-6a29-4de2-bc55-70c52032e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:36.072698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25cfee-ea22-4a4d-ac2b-a981d139973a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:36.078829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0013e0-1677-4487-ade4-dd1cbff6452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:36.079678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0013e0-1677-4487-ade4-dd1cbff6452d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:36.080082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0013e0-1677-4487-ade4-dd1cbff6452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:36.080487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0013e0-1677-4487-ade4-dd1cbff6452d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:36.081304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0013e0-1677-4487-ade4-dd1cbff6452d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:36.084142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0013e0-1677-4487-ade4-dd1cbff6452d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:36.114194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 940/1884] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:35 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:36.130136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0013e0-1677-4487-ade4-dd1cbff6452d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:36.156963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 945/1885] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:36.161372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0013e0-1677-4487-ade4-dd1cbff6452d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:36.161538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398063d3-6a29-4de2-bc55-70c52032e66d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:36.177645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:36.178278 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:36.178567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:36.178848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:36.179849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:36.181698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:36.197536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 941/1886] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:36.198476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:36.203297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:36.237841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398063d3-6a29-4de2-bc55-70c52032e66d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:36.241693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:36.242473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:36.242773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:36.243197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:36.245291 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:36.265708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d34d-3dd6-4e42-9565-a6931c2fe1c9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:36.269522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8454dc-9c29-4a7d-b04b-7d5a0b87bdf6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:36.270205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8454dc-9c29-4a7d-b04b-7d5a0b87bdf6 service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:36.270499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8454dc-9c29-4a7d-b04b-7d5a0b87bdf6 service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:36.270787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8454dc-9c29-4a7d-b04b-7d5a0b87bdf6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:36.277085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:36.281132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8454dc-9c29-4a7d-b04b-7d5a0b87bdf6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:36.283168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8454dc-9c29-4a7d-b04b-7d5a0b87bdf6 service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:36.294050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 942/1887] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:36.294956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8454dc-9c29-4a7d-b04b-7d5a0b87bdf6 service glance] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:36.306239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8454dc-9c29-4a7d-b04b-7d5a0b87bdf6 service glance] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:36.311178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:36.312020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c779b9-b4f8-4d1e-b39b-80ca200cbf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:36.312829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:36.312970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c779b9-b4f8-4d1e-b39b-80ca200cbf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:36.313197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c779b9-b4f8-4d1e-b39b-80ca200cbf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:36.313483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c779b9-b4f8-4d1e-b39b-80ca200cbf59 admin admin] PATH_INFO: `/v3/projects/a2157a203e6246789376151741689a17/users/0651304fa04345dd817cc24a131bc0eb/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:36.323797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 946/1888] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:36.335357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c779b9-b4f8-4d1e-b39b-80ca200cbf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2157a203e6246789376151741689a17, user_id=0651304fa04345dd817cc24a131bc0eb, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:36.338701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c779b9-b4f8-4d1e-b39b-80ca200cbf59 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:36.354650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 943/1889] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:36 2022] PUT /identity/v3/projects/a2157a203e6246789376151741689a17/users/0651304fa04345dd817cc24a131bc0eb/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:36.360858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:36.368890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:36.378916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4950-e86c-4eb5-95c5-8941cdb0bfe4 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:36.456256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cec3e-6f5b-46fc-a5c2-d7ad4ccbcca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:36.457054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cec3e-6f5b-46fc-a5c2-d7ad4ccbcca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:36.457756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cec3e-6f5b-46fc-a5c2-d7ad4ccbcca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:36.458046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cec3e-6f5b-46fc-a5c2-d7ad4ccbcca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:36.459666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cec3e-6f5b-46fc-a5c2-d7ad4ccbcca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:36.462510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cec3e-6f5b-46fc-a5c2-d7ad4ccbcca1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:36.490504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 947/1890] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:36.492232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c779b9-b4f8-4d1e-b39b-80ca200cbf59 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:36.503361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c779b9-b4f8-4d1e-b39b-80ca200cbf59 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:36.509829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:36.510738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:36.511027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:36.511311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] PATH_INFO: `/v3/projects/a2157a203e6246789376151741689a17/users/0651304fa04345dd817cc24a131bc0eb/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:36.513743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2157a203e6246789376151741689a17, user_id=0651304fa04345dd817cc24a131bc0eb, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:36.516582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:36.528758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 944/1891] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:36 2022] PUT /identity/v3/projects/a2157a203e6246789376151741689a17/users/0651304fa04345dd817cc24a131bc0eb/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:36.540634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb695c0-3196-4067-a9b2-a5ddefc4d469 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:36.540982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb695c0-3196-4067-a9b2-a5ddefc4d469 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:36.541281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb695c0-3196-4067-a9b2-a5ddefc4d469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:36.576084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-efb695c0-3196-4067-a9b2-a5ddefc4d469 None None] MFA Rules not processed for user `0651304fa04345dd817cc24a131bc0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:36.577314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-efb695c0-3196-4067-a9b2-a5ddefc4d469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:36.661239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 948/1892] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:36.860755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:36.862533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:36.986577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec19a-900d-4d16-9127-1d24acc2c726 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:37.000285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a581-75b7-4a66-9e1d-b5af5ff638ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:37.001852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a581-75b7-4a66-9e1d-b5af5ff638ee service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:37.002797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a581-75b7-4a66-9e1d-b5af5ff638ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:37.003426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a581-75b7-4a66-9e1d-b5af5ff638ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:37.018121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916a581-75b7-4a66-9e1d-b5af5ff638ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:37.020206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916a581-75b7-4a66-9e1d-b5af5ff638ee service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:37.045947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 945/1893] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:37.151161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb695c0-3196-4067-a9b2-a5ddefc4d469 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:37.162019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb695c0-3196-4067-a9b2-a5ddefc4d469 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:37.166809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e1b3b-0adb-4aa5-8f13-4cb7e9d8a2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:37.167635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1b3b-0adb-4aa5-8f13-4cb7e9d8a2ce service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:37.168164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1b3b-0adb-4aa5-8f13-4cb7e9d8a2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:37.168850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1b3b-0adb-4aa5-8f13-4cb7e9d8a2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:37.235695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e1b3b-0adb-4aa5-8f13-4cb7e9d8a2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:37.237771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e1b3b-0adb-4aa5-8f13-4cb7e9d8a2ce service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:37.248351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 949/1894] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:44.299926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a581-75b7-4a66-9e1d-b5af5ff638ee service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:44.366348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a581-75b7-4a66-9e1d-b5af5ff638ee service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:44.373012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:44.373962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:44.374255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:44.374541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] PATH_INFO: `/v3/users/a89c1588c2c341898cff9df9cdcd606b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:44.375740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89c1588c2c341898cff9df9cdcd606b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:44.377711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:44.426141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89c1588c2c341898cff9df9cdcd606b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:44.426836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89c1588c2c341898cff9df9cdcd606b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:44.436039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89c1588c2c341898cff9df9cdcd606b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:44.441644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:44.451468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89c1588c2c341898cff9df9cdcd606b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:44.458456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89c1588c2c341898cff9df9cdcd606b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:44.465024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 946/1895] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:44 2022] DELETE /identity/v3/users/a89c1588c2c341898cff9df9cdcd606b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:44.471453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234754fb-a2ef-4a0c-a454-be0f5ab855cf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:44.471453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234754fb-a2ef-4a0c-a454-be0f5ab855cf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:44.471453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234754fb-a2ef-4a0c-a454-be0f5ab855cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:44.488401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-234754fb-a2ef-4a0c-a454-be0f5ab855cf None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:44.489671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-234754fb-a2ef-4a0c-a454-be0f5ab855cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:44.509526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:44.556012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 950/1896] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:44.566747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:44.568494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:44.661659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece3ef-2ac6-4433-98bc-5be2fde0a5ba admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:44.667764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4b31-7c45-479b-a227-e31242e7f0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:44.668667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4b31-7c45-479b-a227-e31242e7f0ba service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:44.668966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4b31-7c45-479b-a227-e31242e7f0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:44.669379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4b31-7c45-479b-a227-e31242e7f0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:44.685520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f4b31-7c45-479b-a227-e31242e7f0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:44.691307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f4b31-7c45-479b-a227-e31242e7f0ba service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:44.703801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 947/1897] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:45.088769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234754fb-a2ef-4a0c-a454-be0f5ab855cf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:45.092550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-234754fb-a2ef-4a0c-a454-be0f5ab855cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:45.106855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234754fb-a2ef-4a0c-a454-be0f5ab855cf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:45.113650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:45.114712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:45.114961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:45.115321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] PATH_INFO: `/v3/projects/552dd4d2c61a436e943ecbaad79128f8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:45.117654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] RBAC: Authorizing `identity:delete_project(project_id=552dd4d2c61a436e943ecbaad79128f8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:45.119763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:45.269474 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552dd4d2c61a436e943ecbaad79128f8', 'request_id': 'req-857fa3f6-bd89-4e62-93a6-14a96da4442c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.286176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552dd4d2c61a436e943ecbaad79128f8', 'request_id': 'req-857fa3f6-bd89-4e62-93a6-14a96da4442c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.302298 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552dd4d2c61a436e943ecbaad79128f8', 'request_id': 'req-857fa3f6-bd89-4e62-93a6-14a96da4442c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.328679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] The token cache is being invalidate because project 552dd4d2c61a436e943ecbaad79128f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:45.328981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.330580 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.336364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 951/1898] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:45 2022] DELETE /identity/v3/projects/552dd4d2c61a436e943ecbaad79128f8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:45.337940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4b31-7c45-479b-a227-e31242e7f0ba service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:45.356207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4b31-7c45-479b-a227-e31242e7f0ba service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:45.459370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:45.460775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:45.461228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:45.461874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] PATH_INFO: `/v3/users/0651304fa04345dd817cc24a131bc0eb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:45.463847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0651304fa04345dd817cc24a131bc0eb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:45.466138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:45.562733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0651304fa04345dd817cc24a131bc0eb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.563730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0651304fa04345dd817cc24a131bc0eb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.576773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0651304fa04345dd817cc24a131bc0eb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.618974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0651304fa04345dd817cc24a131bc0eb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.641773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0651304fa04345dd817cc24a131bc0eb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:45.646112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:45.656547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 948/1899] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:45 2022] DELETE /identity/v3/users/0651304fa04345dd817cc24a131bc0eb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:46.132951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.134716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:46.150699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa3f6-bd89-4e62-93a6-14a96da4442c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.232043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.236605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:46.236820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.236820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.236820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.236820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] PATH_INFO: `/v3/projects/a2157a203e6246789376151741689a17` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.237577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2157a203e6246789376151741689a17)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.239775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:46.265389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45287bf2-7e4b-48b9-a688-1cb530eee03c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.275076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.276976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.276976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.276976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] PATH_INFO: `/v3/users/54029094e13245d1b94108f0c394a522` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.279526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54029094e13245d1b94108f0c394a522)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.281597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:46.308988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:46.310809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2157a203e6246789376151741689a17', 'request_id': 'req-4bda9964-054c-4503-9a6b-4d8d66a984ef'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.318926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2157a203e6246789376151741689a17', 'request_id': 'req-4bda9964-054c-4503-9a6b-4d8d66a984ef'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.330036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2157a203e6246789376151741689a17', 'request_id': 'req-4bda9964-054c-4503-9a6b-4d8d66a984ef'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.345888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54029094e13245d1b94108f0c394a522'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.347463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54029094e13245d1b94108f0c394a522'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.349606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] The token cache is being invalidate because project a2157a203e6246789376151741689a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:46.350145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.351431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4bda9964-054c-4503-9a6b-4d8d66a984ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.354476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 952/1900] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:46 2022] DELETE /identity/v3/projects/a2157a203e6246789376151741689a17 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:46.359172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4d54-3bb8-464c-bf47-2ac4f5701823 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.359895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54029094e13245d1b94108f0c394a522'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.361880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4d54-3bb8-464c-bf47-2ac4f5701823 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.362388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4d54-3bb8-464c-bf47-2ac4f5701823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.374203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54029094e13245d1b94108f0c394a522'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.385160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2d2d4d54-3bb8-464c-bf47-2ac4f5701823 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:46.386516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2d2d4d54-3bb8-464c-bf47-2ac4f5701823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:46.394011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e3a84620-f338-4200-b8c7-21ac8797b0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54029094e13245d1b94108f0c394a522'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:46.404976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 949/1901] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:46 2022] DELETE /identity/v3/users/54029094e13245d1b94108f0c394a522 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:46.406556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd0432-8cfe-422b-b97a-710e5cfe97c7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.406851 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd0432-8cfe-422b-b97a-710e5cfe97c7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.407134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd0432-8cfe-422b-b97a-710e5cfe97c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.426600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f0bd0432-8cfe-422b-b97a-710e5cfe97c7 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:46.427808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0bd0432-8cfe-422b-b97a-710e5cfe97c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:46.456163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 953/1902] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:46.463729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff95bea-9d80-438a-b832-12197579f63d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.464039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff95bea-9d80-438a-b832-12197579f63d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.464296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff95bea-9d80-438a-b832-12197579f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.489759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4ff95bea-9d80-438a-b832-12197579f63d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:46.491654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ff95bea-9d80-438a-b832-12197579f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:46.521590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 950/1903] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:46.605991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 954/1904] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:46.606511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd0432-8cfe-422b-b97a-710e5cfe97c7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.608039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0bd0432-8cfe-422b-b97a-710e5cfe97c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:46.610178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff95bea-9d80-438a-b832-12197579f63d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.622707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff95bea-9d80-438a-b832-12197579f63d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.629091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.629690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.629984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.630271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.631016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:46.631332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.633782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:46.652913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 955/1905] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:46.656892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.667481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef128954-f640-4f76-a96f-c58f95c25019 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.672943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27766df0-bb16-4046-a6ca-ff7974d6d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.673634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766df0-bb16-4046-a6ca-ff7974d6d832 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.674824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766df0-bb16-4046-a6ca-ff7974d6d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.674824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766df0-bb16-4046-a6ca-ff7974d6d832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.675064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27766df0-bb16-4046-a6ca-ff7974d6d832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.676980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27766df0-bb16-4046-a6ca-ff7974d6d832 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:46.695486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd0432-8cfe-422b-b97a-710e5cfe97c7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.708515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 956/1906] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:46 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:46.710571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adc6be-440c-4773-a3e2-1d22bad550b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.713161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27766df0-bb16-4046-a6ca-ff7974d6d832 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.717877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc6be-440c-4773-a3e2-1d22bad550b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.718238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc6be-440c-4773-a3e2-1d22bad550b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.718541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc6be-440c-4773-a3e2-1d22bad550b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.736383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adc6be-440c-4773-a3e2-1d22bad550b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.738089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adc6be-440c-4773-a3e2-1d22bad550b0 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:46.771659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 951/1907] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:46.795228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:46.819804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27766df0-bb16-4046-a6ca-ff7974d6d832 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.825798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c60b87-2dd8-4f54-8ec7-07320466c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.826770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60b87-2dd8-4f54-8ec7-07320466c499 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.827156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60b87-2dd8-4f54-8ec7-07320466c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.827653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60b87-2dd8-4f54-8ec7-07320466c499 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.828531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c60b87-2dd8-4f54-8ec7-07320466c499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.831054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c60b87-2dd8-4f54-8ec7-07320466c499 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:46.861335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 957/1908] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:46 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:46.862892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adc6be-440c-4773-a3e2-1d22bad550b0 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.877669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adc6be-440c-4773-a3e2-1d22bad550b0 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.883565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4a50c-224d-4934-8b12-0880b66d1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.884256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a50c-224d-4934-8b12-0880b66d1d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.884545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a50c-224d-4934-8b12-0880b66d1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.884842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a50c-224d-4934-8b12-0880b66d1d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.885587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4a50c-224d-4934-8b12-0880b66d1d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.887207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4a50c-224d-4934-8b12-0880b66d1d2a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:46.900655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 952/1909] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:46.905574 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c60b87-2dd8-4f54-8ec7-07320466c499 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.919184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c60b87-2dd8-4f54-8ec7-07320466c499 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.924138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b562c-41ee-4d81-a938-04994dff243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.924819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b562c-41ee-4d81-a938-04994dff243e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.925110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b562c-41ee-4d81-a938-04994dff243e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.925401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b562c-41ee-4d81-a938-04994dff243e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.926177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b562c-41ee-4d81-a938-04994dff243e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.927791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b562c-41ee-4d81-a938-04994dff243e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:46.941587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 958/1910] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:00:46.943893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4a50c-224d-4934-8b12-0880b66d1d2a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:46.952607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:46.956987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4a50c-224d-4934-8b12-0880b66d1d2a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:46.967484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226dbfd-2c19-49e7-b85d-64da56557e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:46.968414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226dbfd-2c19-49e7-b85d-64da56557e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:46.968769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226dbfd-2c19-49e7-b85d-64da56557e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:46.969312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226dbfd-2c19-49e7-b85d-64da56557e40 admin admin] PATH_INFO: `/v3/projects/0e3465b2cf1d4e05b84e706d1bd7ee88/users/13da4dd9f8d143269be87d108f41d86e/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:46.987369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226dbfd-2c19-49e7-b85d-64da56557e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3465b2cf1d4e05b84e706d1bd7ee88, user_id=13da4dd9f8d143269be87d108f41d86e, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:46.992376 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226dbfd-2c19-49e7-b85d-64da56557e40 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.013607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 953/1911] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:46 2022] PUT /identity/v3/projects/0e3465b2cf1d4e05b84e706d1bd7ee88/users/13da4dd9f8d143269be87d108f41d86e/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:47.024297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44baf9e-6deb-4156-b54d-3cf694e508bc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.024689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44baf9e-6deb-4156-b54d-3cf694e508bc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.025056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44baf9e-6deb-4156-b54d-3cf694e508bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.057994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c44baf9e-6deb-4156-b54d-3cf694e508bc None None] MFA Rules not processed for user `13da4dd9f8d143269be87d108f41d86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:47.059360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c44baf9e-6deb-4156-b54d-3cf694e508bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:47.141588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 959/1912] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:47.148857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226dbfd-2c19-49e7-b85d-64da56557e40 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:47.203086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44baf9e-6deb-4156-b54d-3cf694e508bc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:47.204984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c44baf9e-6deb-4156-b54d-3cf694e508bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:47.251874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226dbfd-2c19-49e7-b85d-64da56557e40 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:47.260467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2067c-4ce8-449a-85fb-c1905b4f857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:47.261760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2067c-4ce8-449a-85fb-c1905b4f857c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.262915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2067c-4ce8-449a-85fb-c1905b4f857c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.263461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2067c-4ce8-449a-85fb-c1905b4f857c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.265358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2067c-4ce8-449a-85fb-c1905b4f857c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:47.267269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2067c-4ce8-449a-85fb-c1905b4f857c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.311432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 954/1913] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:47 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:47.315748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2067c-4ce8-449a-85fb-c1905b4f857c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:47.318939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44baf9e-6deb-4156-b54d-3cf694e508bc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:47.444908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:47.454475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:47.455656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.456015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.456368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] PATH_INFO: `/v3/projects/12f757b4c9ca40cf8a9227f931f30080` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.460140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f757b4c9ca40cf8a9227f931f30080)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:47.462181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.466703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2067c-4ce8-449a-85fb-c1905b4f857c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:47.474900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf862-e668-4758-9ed8-de71f4f6226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:47.476302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf862-e668-4758-9ed8-de71f4f6226b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.476675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf862-e668-4758-9ed8-de71f4f6226b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.477087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf862-e668-4758-9ed8-de71f4f6226b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.477845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdf862-e668-4758-9ed8-de71f4f6226b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:47.479809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdf862-e668-4758-9ed8-de71f4f6226b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.508425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 955/1914] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:47 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:47.509739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf862-e668-4758-9ed8-de71f4f6226b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:47.523038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf862-e668-4758-9ed8-de71f4f6226b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:47.533371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f757b4c9ca40cf8a9227f931f30080', 'request_id': 'req-7fdccadb-afb9-40a7-89ec-7472f384a27f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.542205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f757b4c9ca40cf8a9227f931f30080', 'request_id': 'req-7fdccadb-afb9-40a7-89ec-7472f384a27f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.557126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f757b4c9ca40cf8a9227f931f30080', 'request_id': 'req-7fdccadb-afb9-40a7-89ec-7472f384a27f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.572392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] The token cache is being invalidate because project 12f757b4c9ca40cf8a9227f931f30080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:47.572789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.574923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.576945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 960/1915] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:47 2022] DELETE /identity/v3/projects/12f757b4c9ca40cf8a9227f931f30080 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:47.583332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:47.586451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:47.588617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:47.596231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:47.596976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.597283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.597847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.598786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:47.601253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.609935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdccadb-afb9-40a7-89ec-7472f384a27f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:47.615394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:47.617064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 956/1916] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:47.617214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.617214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.617392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] PATH_INFO: `/v3/users/828f90f57d0a4decad94a40bea8956f6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.618880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=828f90f57d0a4decad94a40bea8956f6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:47.620825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.620954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:47.622727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:47.635432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9991f6-34ba-48a3-8f23-6489512c7450 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:47.640576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346314ea-e47c-4da2-9586-74035483a96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:47.641521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346314ea-e47c-4da2-9586-74035483a96b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.641884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346314ea-e47c-4da2-9586-74035483a96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.642179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346314ea-e47c-4da2-9586-74035483a96b admin admin] PATH_INFO: `/v3/projects/a9f561215e8d4cfaa51be6a5d5ddfe55/users/ace5fce114f247d6a95d37e69ee97f39/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.659109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346314ea-e47c-4da2-9586-74035483a96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f561215e8d4cfaa51be6a5d5ddfe55, user_id=ace5fce114f247d6a95d37e69ee97f39, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:47.661860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346314ea-e47c-4da2-9586-74035483a96b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.674208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828f90f57d0a4decad94a40bea8956f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.675201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828f90f57d0a4decad94a40bea8956f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.679547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 957/1917] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:47 2022] PUT /identity/v3/projects/a9f561215e8d4cfaa51be6a5d5ddfe55/users/ace5fce114f247d6a95d37e69ee97f39/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:47.680795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346314ea-e47c-4da2-9586-74035483a96b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:47.686400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828f90f57d0a4decad94a40bea8956f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.694920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828f90f57d0a4decad94a40bea8956f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.695589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828f90f57d0a4decad94a40bea8956f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:47.714527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 961/1918] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:47 2022] DELETE /identity/v3/users/828f90f57d0a4decad94a40bea8956f6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:47.747673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346314ea-e47c-4da2-9586-74035483a96b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:47.850325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4cee1-d011-4116-bf9d-98ef646149d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:47.851307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4cee1-d011-4116-bf9d-98ef646149d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.851603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4cee1-d011-4116-bf9d-98ef646149d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.851890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4cee1-d011-4116-bf9d-98ef646149d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.852640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4cee1-d011-4116-bf9d-98ef646149d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:47.854518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4cee1-d011-4116-bf9d-98ef646149d5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.873593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 958/1919] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:47.877417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:47.878884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:47.893502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a88fdc-08c2-4ba8-9c66-cf45058e61ec admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:47.899399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:47.900479 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.900925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.901366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] PATH_INFO: `/v3/projects/a9f561215e8d4cfaa51be6a5d5ddfe55/users/ace5fce114f247d6a95d37e69ee97f39/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.904845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f561215e8d4cfaa51be6a5d5ddfe55, user_id=ace5fce114f247d6a95d37e69ee97f39, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:47.908405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:47.924422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 962/1920] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:47 2022] PUT /identity/v3/projects/a9f561215e8d4cfaa51be6a5d5ddfe55/users/ace5fce114f247d6a95d37e69ee97f39/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:47.935963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f6ff-25e6-496f-ab85-fb9a6ce23e94 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:47.936262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f6ff-25e6-496f-ab85-fb9a6ce23e94 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:47.936576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64f6ff-25e6-496f-ab85-fb9a6ce23e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:47.984055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6d64f6ff-25e6-496f-ab85-fb9a6ce23e94 None None] MFA Rules not processed for user `ace5fce114f247d6a95d37e69ee97f39`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:47.985411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6d64f6ff-25e6-496f-ab85-fb9a6ce23e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:48.058905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:48.070050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 959/1921] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:48.081519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.083406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:48.088605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64f6ff-25e6-496f-ab85-fb9a6ce23e94 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.090453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6d64f6ff-25e6-496f-ab85-fb9a6ce23e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:48.159458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:48.165605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7f0a9-dfc1-41f3-80d0-58a46729ffe6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.168220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64f6ff-25e6-496f-ab85-fb9a6ce23e94 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.170375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eddd6f-3fa0-41ab-9cc9-98c75415026e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.171251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eddd6f-3fa0-41ab-9cc9-98c75415026e service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.171679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eddd6f-3fa0-41ab-9cc9-98c75415026e service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.172159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eddd6f-3fa0-41ab-9cc9-98c75415026e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.173138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.174041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.174328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.174609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] PATH_INFO: `/v3/projects/f147f628d18b47fd877f17bc59eda036` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.175783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f147f628d18b47fd877f17bc59eda036)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.177805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:48.181987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eddd6f-3fa0-41ab-9cc9-98c75415026e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.183458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eddd6f-3fa0-41ab-9cc9-98c75415026e service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:48.193844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 963/1922] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:48.235210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f147f628d18b47fd877f17bc59eda036', 'request_id': 'req-787a7434-6a09-4072-83d9-500283090113'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:48.244260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f147f628d18b47fd877f17bc59eda036', 'request_id': 'req-787a7434-6a09-4072-83d9-500283090113'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:48.250271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f147f628d18b47fd877f17bc59eda036', 'request_id': 'req-787a7434-6a09-4072-83d9-500283090113'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:48.263895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] The token cache is being invalidate because project f147f628d18b47fd877f17bc59eda036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:48.264196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:48.264880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-787a7434-6a09-4072-83d9-500283090113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:48.266523 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 960/1923] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:48 2022] DELETE /identity/v3/projects/f147f628d18b47fd877f17bc59eda036 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:48.271469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614675a-797c-4cc9-8dba-e2c371598fce None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.271770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614675a-797c-4cc9-8dba-e2c371598fce None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.272062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614675a-797c-4cc9-8dba-e2c371598fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.294438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8614675a-797c-4cc9-8dba-e2c371598fce None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:48.297964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8614675a-797c-4cc9-8dba-e2c371598fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:48.362447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 964/1924] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:48.371754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd4eb-fb5c-4be9-985d-6b95bff52ef5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.371895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd4eb-fb5c-4be9-985d-6b95bff52ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.372221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd4eb-fb5c-4be9-985d-6b95bff52ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.420833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fc1fd4eb-fb5c-4be9-985d-6b95bff52ef5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:48.422068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fc1fd4eb-fb5c-4be9-985d-6b95bff52ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:48.441139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 961/1925] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:48.445152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614675a-797c-4cc9-8dba-e2c371598fce None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.456484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614675a-797c-4cc9-8dba-e2c371598fce None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.463464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.464459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.464753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.465110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.465924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:48.466447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.468251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:48.489561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 965/1926] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:48.490999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fd4eb-fb5c-4be9-985d-6b95bff52ef5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.509818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fd4eb-fb5c-4be9-985d-6b95bff52ef5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.517962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3585a0-f200-407a-b851-c1a142ec683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.519255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3585a0-f200-407a-b851-c1a142ec683c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.519255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3585a0-f200-407a-b851-c1a142ec683c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.523333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3585a0-f200-407a-b851-c1a142ec683c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.525522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3585a0-f200-407a-b851-c1a142ec683c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.527575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3585a0-f200-407a-b851-c1a142ec683c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:48.565739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 962/1927] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:48 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:48.567857 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.580476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212408a-793e-4ffc-b096-25beef9b95e0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.685673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31476e-9ef0-4c08-8706-e3bbf78f17f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.686465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31476e-9ef0-4c08-8706-e3bbf78f17f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.686787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31476e-9ef0-4c08-8706-e3bbf78f17f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.687031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31476e-9ef0-4c08-8706-e3bbf78f17f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.687950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31476e-9ef0-4c08-8706-e3bbf78f17f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.690264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31476e-9ef0-4c08-8706-e3bbf78f17f5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:48.725187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 966/1928] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:48 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:48.729917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3585a0-f200-407a-b851-c1a142ec683c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.743898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3585a0-f200-407a-b851-c1a142ec683c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.749494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d626ec-0a99-4b55-875f-08decb15825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.750336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d626ec-0a99-4b55-875f-08decb15825b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.750651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d626ec-0a99-4b55-875f-08decb15825b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.751046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d626ec-0a99-4b55-875f-08decb15825b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.751865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d626ec-0a99-4b55-875f-08decb15825b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.753985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d626ec-0a99-4b55-875f-08decb15825b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:48.769609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 963/1929] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:48.772010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31476e-9ef0-4c08-8706-e3bbf78f17f5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.783436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31476e-9ef0-4c08-8706-e3bbf78f17f5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.791078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.792189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.792902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.793270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.794303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.796221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:48.811072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 967/1930] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:48.815087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d626ec-0a99-4b55-875f-08decb15825b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.828200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d626ec-0a99-4b55-875f-08decb15825b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.833019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6aaa8-fba3-4c89-8f30-194124a3d25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.833960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6aaa8-fba3-4c89-8f30-194124a3d25c admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.834255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6aaa8-fba3-4c89-8f30-194124a3d25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.834540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6aaa8-fba3-4c89-8f30-194124a3d25c admin admin] PATH_INFO: `/v3/projects/bf5cecf2c895421ab2fd8523dca48587/users/554b01d7fc9e4062add7686389aac66d/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.859975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6aaa8-fba3-4c89-8f30-194124a3d25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5cecf2c895421ab2fd8523dca48587, user_id=554b01d7fc9e4062add7686389aac66d, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.863021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6aaa8-fba3-4c89-8f30-194124a3d25c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:48.880322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:48.886907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 964/1931] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:48 2022] PUT /identity/v3/projects/bf5cecf2c895421ab2fd8523dca48587/users/554b01d7fc9e4062add7686389aac66d/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:48.888203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:48.897857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f691-39e6-46fe-8254-bf8d101e1dbf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.898193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f691-39e6-46fe-8254-bf8d101e1dbf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.898431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f691-39e6-46fe-8254-bf8d101e1dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.905854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068540c2-99c7-4745-a5f6-249b7c45b4d3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:48.938430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4e40f691-39e6-46fe-8254-bf8d101e1dbf None None] MFA Rules not processed for user `554b01d7fc9e4062add7686389aac66d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:48.939744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e40f691-39e6-46fe-8254-bf8d101e1dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:48.951938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:48.962489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:48.970067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:48.970998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:48.971532 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:48.972546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] PATH_INFO: `/v3/users/13da4dd9f8d143269be87d108f41d86e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:48.973455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13da4dd9f8d143269be87d108f41d86e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:48.975971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:49.017929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 965/1932] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:49.025636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13da4dd9f8d143269be87d108f41d86e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.026345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13da4dd9f8d143269be87d108f41d86e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.030039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f691-39e6-46fe-8254-bf8d101e1dbf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:49.031743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e40f691-39e6-46fe-8254-bf8d101e1dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:49.033986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13da4dd9f8d143269be87d108f41d86e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.043683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13da4dd9f8d143269be87d108f41d86e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.044488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27d2fb88-07dc-4c2f-9f81-0e56976e61d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13da4dd9f8d143269be87d108f41d86e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.067080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 968/1933] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:48 2022] DELETE /identity/v3/users/13da4dd9f8d143269be87d108f41d86e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:49.071875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702589-299f-481d-8f86-1f4cf802c963 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:49.072171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702589-299f-481d-8f86-1f4cf802c963 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:49.072486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702589-299f-481d-8f86-1f4cf802c963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:49.094119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f3702589-299f-481d-8f86-1f4cf802c963 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:49.095325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f3702589-299f-481d-8f86-1f4cf802c963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:49.102193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f691-39e6-46fe-8254-bf8d101e1dbf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:49.167835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 969/1934] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:49.168409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:49.168917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:49.169202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:49.169635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:49.171771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:49.177940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3702589-299f-481d-8f86-1f4cf802c963 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:49.180248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f3702589-299f-481d-8f86-1f4cf802c963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:49.239315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:49.240814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:49.241366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3702589-299f-481d-8f86-1f4cf802c963 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:49.245624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9738-a42d-48d2-a69e-614eea0b4ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:49.246311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9738-a42d-48d2-a69e-614eea0b4ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:49.246742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9738-a42d-48d2-a69e-614eea0b4ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:49.247062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9738-a42d-48d2-a69e-614eea0b4ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:49.251483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 966/1935] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:49.260143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c9738-a42d-48d2-a69e-614eea0b4ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:49.262169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c9738-a42d-48d2-a69e-614eea0b4ff1 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:49.271259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 970/1936] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:00:49.582195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:49.583841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:49.602073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add18ca-845f-480f-a0b5-2dc494457e88 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:49.608587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:49.609641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:49.609977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:49.610602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] PATH_INFO: `/v3/projects/0e3465b2cf1d4e05b84e706d1bd7ee88` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:49.613015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3465b2cf1d4e05b84e706d1bd7ee88)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:49.615126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:49.635815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:49.670391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3465b2cf1d4e05b84e706d1bd7ee88', 'request_id': 'req-61511ff5-c7c7-4f58-a245-da0a24e2d852'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.677767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3465b2cf1d4e05b84e706d1bd7ee88', 'request_id': 'req-61511ff5-c7c7-4f58-a245-da0a24e2d852'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.692071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3465b2cf1d4e05b84e706d1bd7ee88', 'request_id': 'req-61511ff5-c7c7-4f58-a245-da0a24e2d852'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.703772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] The token cache is being invalidate because project 0e3465b2cf1d4e05b84e706d1bd7ee88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:49.704062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.705097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.706796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 967/1937] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:49 2022] DELETE /identity/v3/projects/0e3465b2cf1d4e05b84e706d1bd7ee88 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:49.711488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9738-a42d-48d2-a69e-614eea0b4ff1 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:49.723225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9738-a42d-48d2-a69e-614eea0b4ff1 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:49.735623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:49.801934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:49.802932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:49.803295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:49.803826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] PATH_INFO: `/v3/users/ace5fce114f247d6a95d37e69ee97f39` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:49.805490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace5fce114f247d6a95d37e69ee97f39)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:49.808077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:49.865078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace5fce114f247d6a95d37e69ee97f39'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.866317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace5fce114f247d6a95d37e69ee97f39'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.874281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace5fce114f247d6a95d37e69ee97f39'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.887808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace5fce114f247d6a95d37e69ee97f39'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.888873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1585eebe-6266-4279-89a5-aec3765c5aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace5fce114f247d6a95d37e69ee97f39'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:49.911149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 971/1938] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:49 2022] DELETE /identity/v3/users/ace5fce114f247d6a95d37e69ee97f39 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:50.228407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:50.230009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:50.253227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511ff5-c7c7-4f58-a245-da0a24e2d852 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:50.314589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:50.315468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.315757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.316039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] PATH_INFO: `/v3/projects/a9f561215e8d4cfaa51be6a5d5ddfe55` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.317236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f561215e8d4cfaa51be6a5d5ddfe55)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:50.319800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:50.373378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f561215e8d4cfaa51be6a5d5ddfe55', 'request_id': 'req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:50.381124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f561215e8d4cfaa51be6a5d5ddfe55', 'request_id': 'req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:50.389902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f561215e8d4cfaa51be6a5d5ddfe55', 'request_id': 'req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:50.405999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] The token cache is being invalidate because project a9f561215e8d4cfaa51be6a5d5ddfe55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:50.406353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:50.406968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-124db0b5-ca11-4c0d-a3e9-88d1ef8f99d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:50.409591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 968/1939] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:50 2022] DELETE /identity/v3/projects/a9f561215e8d4cfaa51be6a5d5ddfe55 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:50.414306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c5176-40e7-421d-9f71-0abe58a291aa None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.414807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c5176-40e7-421d-9f71-0abe58a291aa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.415212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c5176-40e7-421d-9f71-0abe58a291aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.434661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-068c5176-40e7-421d-9f71-0abe58a291aa None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:50.435883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-068c5176-40e7-421d-9f71-0abe58a291aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:50.498555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 972/1940] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:50.506526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56edf-17a1-48fd-b255-be87e7c137e1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.507065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56edf-17a1-48fd-b255-be87e7c137e1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.507360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56edf-17a1-48fd-b255-be87e7c137e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.535738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-05a56edf-17a1-48fd-b255-be87e7c137e1 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:50.537356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-05a56edf-17a1-48fd-b255-be87e7c137e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:50.546704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 969/1941] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:50.550987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c5176-40e7-421d-9f71-0abe58a291aa None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:50.568652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c5176-40e7-421d-9f71-0abe58a291aa None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:50.578199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:50.578887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.579223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.579458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.580202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:50.581040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:50.582747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:50.595975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 973/1942] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:50.600214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a56edf-17a1-48fd-b255-be87e7c137e1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:50.610523 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a56edf-17a1-48fd-b255-be87e7c137e1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:50.617736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312d494-fb15-4ffe-931f-0e2f61af3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:50.617736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d494-fb15-4ffe-931f-0e2f61af3154 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.617736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d494-fb15-4ffe-931f-0e2f61af3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.617736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d494-fb15-4ffe-931f-0e2f61af3154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.618676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312d494-fb15-4ffe-931f-0e2f61af3154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:50.620699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312d494-fb15-4ffe-931f-0e2f61af3154 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:50.648743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 970/1943] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:50 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:50.652898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:50.663785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143f7c6-2d5c-49a7-be7d-95e179ef1fda admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:50.690289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:50.748987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1ad2-ffc6-4d00-af43-7e35e1eccdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:50.749719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1ad2-ffc6-4d00-af43-7e35e1eccdff admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.750011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1ad2-ffc6-4d00-af43-7e35e1eccdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.750576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1ad2-ffc6-4d00-af43-7e35e1eccdff admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.751497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b1ad2-ffc6-4d00-af43-7e35e1eccdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:50.754074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b1ad2-ffc6-4d00-af43-7e35e1eccdff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:50.777295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 974/1944] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:50 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:50.781380 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312d494-fb15-4ffe-931f-0e2f61af3154 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:50.794926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312d494-fb15-4ffe-931f-0e2f61af3154 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:50.802808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f4e14-69cf-48b5-85ed-92779e45014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:50.804334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4e14-69cf-48b5-85ed-92779e45014a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.804718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4e14-69cf-48b5-85ed-92779e45014a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.805008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4e14-69cf-48b5-85ed-92779e45014a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.805822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f4e14-69cf-48b5-85ed-92779e45014a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:50.807483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f4e14-69cf-48b5-85ed-92779e45014a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:50.809091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:50.822220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 971/1945] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:50.827335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1ad2-ffc6-4d00-af43-7e35e1eccdff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:50.839142 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1ad2-ffc6-4d00-af43-7e35e1eccdff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:50.843824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1778c-0be1-4c73-86a4-d74ba10f7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:50.844523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1778c-0be1-4c73-86a4-d74ba10f7594 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.844812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1778c-0be1-4c73-86a4-d74ba10f7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.845091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1778c-0be1-4c73-86a4-d74ba10f7594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.845866 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1778c-0be1-4c73-86a4-d74ba10f7594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:50.847464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1778c-0be1-4c73-86a4-d74ba10f7594 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:50.858294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 975/1946] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:50.862492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f4e14-69cf-48b5-85ed-92779e45014a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:50.872995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f4e14-69cf-48b5-85ed-92779e45014a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:50.877708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:50.878607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.878892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.879225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] PATH_INFO: `/v3/projects/dced7a5062494e2ca9da92bda728f9a7/users/19c356da1eb9449cb8477dbf13fea7d5/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.899505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dced7a5062494e2ca9da92bda728f9a7, user_id=19c356da1eb9449cb8477dbf13fea7d5, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:50.903673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:50.918829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 972/1947] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:50 2022] PUT /identity/v3/projects/dced7a5062494e2ca9da92bda728f9a7/users/19c356da1eb9449cb8477dbf13fea7d5/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:50.929357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867084ec-6e42-4fd8-8c4d-938797dc5fb3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:50.929681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867084ec-6e42-4fd8-8c4d-938797dc5fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:50.930086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867084ec-6e42-4fd8-8c4d-938797dc5fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:50.961810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-867084ec-6e42-4fd8-8c4d-938797dc5fb3 None None] MFA Rules not processed for user `19c356da1eb9449cb8477dbf13fea7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:50.963015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-867084ec-6e42-4fd8-8c4d-938797dc5fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:51.058789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 976/1948] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:51.081012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:51.083692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:51.161698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c64503-e18f-4123-9763-5d42fab5cb2a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:51.167055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d38b1-c3ab-4dbc-88b1-70beb2451ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:51.167908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d38b1-c3ab-4dbc-88b1-70beb2451ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:51.168425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d38b1-c3ab-4dbc-88b1-70beb2451ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:51.168947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d38b1-c3ab-4dbc-88b1-70beb2451ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:51.184490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d38b1-c3ab-4dbc-88b1-70beb2451ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:51.186331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d38b1-c3ab-4dbc-88b1-70beb2451ea4 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:51.201689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 973/1949] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:51.853460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867084ec-6e42-4fd8-8c4d-938797dc5fb3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:51.855242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-867084ec-6e42-4fd8-8c4d-938797dc5fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:51.951736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867084ec-6e42-4fd8-8c4d-938797dc5fb3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:51.956495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:51.957654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:51.957944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:51.958231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] PATH_INFO: `/v3/users/554b01d7fc9e4062add7686389aac66d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:51.961031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554b01d7fc9e4062add7686389aac66d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:51.962443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:52.017478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:52.034025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554b01d7fc9e4062add7686389aac66d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:52.034904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554b01d7fc9e4062add7686389aac66d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:52.047622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554b01d7fc9e4062add7686389aac66d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:52.065146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554b01d7fc9e4062add7686389aac66d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:52.066249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554b01d7fc9e4062add7686389aac66d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:52.125912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 977/1950] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:51 2022] DELETE /identity/v3/users/554b01d7fc9e4062add7686389aac66d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:52.130134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330bfd-b49a-457b-a836-795a894e1ad2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:52.130836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330bfd-b49a-457b-a836-795a894e1ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:52.130836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330bfd-b49a-457b-a836-795a894e1ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:52.167821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-01330bfd-b49a-457b-a836-795a894e1ad2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:52.169725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-01330bfd-b49a-457b-a836-795a894e1ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:52.243912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 974/1951] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:52.250850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:52.252387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:52.349979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04ac7f-22b1-4285-ab98-d08975cba612 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:52.354535 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4d783-d5e6-4cf8-aa5d-516dbd89dee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:52.355437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4d783-d5e6-4cf8-aa5d-516dbd89dee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:52.356168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4d783-d5e6-4cf8-aa5d-516dbd89dee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:52.356466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4d783-d5e6-4cf8-aa5d-516dbd89dee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:52.370437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4d783-d5e6-4cf8-aa5d-516dbd89dee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:52.372074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4d783-d5e6-4cf8-aa5d-516dbd89dee0 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:52.388720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 978/1952] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:52.974304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330bfd-b49a-457b-a836-795a894e1ad2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:52.976828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-01330bfd-b49a-457b-a836-795a894e1ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:52.998362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330bfd-b49a-457b-a836-795a894e1ad2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:53.003590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:53.004623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.004919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.005269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] PATH_INFO: `/v3/projects/bf5cecf2c895421ab2fd8523dca48587` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.006701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5cecf2c895421ab2fd8523dca48587)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:53.008916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:53.080514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5cecf2c895421ab2fd8523dca48587', 'request_id': 'req-549af68f-999f-4f59-8953-c712a1d65407'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:53.091763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5cecf2c895421ab2fd8523dca48587', 'request_id': 'req-549af68f-999f-4f59-8953-c712a1d65407'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:53.099698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5cecf2c895421ab2fd8523dca48587', 'request_id': 'req-549af68f-999f-4f59-8953-c712a1d65407'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:53.110896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:53.117977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] The token cache is being invalidate because project bf5cecf2c895421ab2fd8523dca48587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:53.119746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:53.120984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-549af68f-999f-4f59-8953-c712a1d65407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:53.122501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 975/1953] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:52 2022] DELETE /identity/v3/projects/bf5cecf2c895421ab2fd8523dca48587 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:53.127306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9b735-e09e-4120-a688-220b6cebcfec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.127794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9b735-e09e-4120-a688-220b6cebcfec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.127872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9b735-e09e-4120-a688-220b6cebcfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.150244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ace9b735-e09e-4120-a688-220b6cebcfec None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:53.153846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ace9b735-e09e-4120-a688-220b6cebcfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:53.273436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 979/1954] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:53.282777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166965-89d5-4eb4-9abd-2b55da4f5cca None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.283296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166965-89d5-4eb4-9abd-2b55da4f5cca None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.283397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166965-89d5-4eb4-9abd-2b55da4f5cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.308425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ac166965-89d5-4eb4-9abd-2b55da4f5cca None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:53.310394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ac166965-89d5-4eb4-9abd-2b55da4f5cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:53.323608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 976/1955] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:53.327502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9b735-e09e-4120-a688-220b6cebcfec None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:53.339099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9b735-e09e-4120-a688-220b6cebcfec None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:53.345168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:53.345975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.346539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.346539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.347397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:53.348159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:53.349961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:53.369697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 980/1956] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:53.371073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac166965-89d5-4eb4-9abd-2b55da4f5cca None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:53.400187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac166965-89d5-4eb4-9abd-2b55da4f5cca None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:53.414074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a082d-2c88-4ba0-b908-e3c41494b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:53.415626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a082d-2c88-4ba0-b908-e3c41494b0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.416156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a082d-2c88-4ba0-b908-e3c41494b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.417184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a082d-2c88-4ba0-b908-e3c41494b0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.418238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a082d-2c88-4ba0-b908-e3c41494b0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:53.422984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a082d-2c88-4ba0-b908-e3c41494b0d2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:53.492617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 977/1957] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:53 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:53.497269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:53.514567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381411-4cc1-407f-b3a7-6017f49932c7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:53.603675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:53.638721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0f20b-f56d-42cb-bb2b-b09f9bae0da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:53.639705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0f20b-f56d-42cb-bb2b-b09f9bae0da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.640175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0f20b-f56d-42cb-bb2b-b09f9bae0da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.640609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0f20b-f56d-42cb-bb2b-b09f9bae0da1 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.641466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0f20b-f56d-42cb-bb2b-b09f9bae0da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:53.643775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0f20b-f56d-42cb-bb2b-b09f9bae0da1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:53.690861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 981/1958] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:53 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:53.691600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a082d-2c88-4ba0-b908-e3c41494b0d2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:53.710354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a082d-2c88-4ba0-b908-e3c41494b0d2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:53.715936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cf155-f0ea-42a8-a3b8-a3fe8c4bc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:53.716645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cf155-f0ea-42a8-a3b8-a3fe8c4bc611 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.716937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cf155-f0ea-42a8-a3b8-a3fe8c4bc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.717220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cf155-f0ea-42a8-a3b8-a3fe8c4bc611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.720953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cf155-f0ea-42a8-a3b8-a3fe8c4bc611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:53.722826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cf155-f0ea-42a8-a3b8-a3fe8c4bc611 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:53.745608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 978/1959] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:00:53.747788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0f20b-f56d-42cb-bb2b-b09f9bae0da1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:53.759922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0f20b-f56d-42cb-bb2b-b09f9bae0da1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:53.766426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b3d8b-1611-4fae-8124-69caff484bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:53.767417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3d8b-1611-4fae-8124-69caff484bff admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.767796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3d8b-1611-4fae-8124-69caff484bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.768141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3d8b-1611-4fae-8124-69caff484bff admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.768953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3d8b-1611-4fae-8124-69caff484bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:53.770765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3d8b-1611-4fae-8124-69caff484bff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:53.783583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 982/1960] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:00:53.787609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cf155-f0ea-42a8-a3b8-a3fe8c4bc611 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:53.800315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cf155-f0ea-42a8-a3b8-a3fe8c4bc611 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:53.812548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:53.812548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.812548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.812548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] PATH_INFO: `/v3/projects/1706eab7d2604687a3071eb6d6e99663/users/cace62d4c3374acca12a25d7542319b9/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.836335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1706eab7d2604687a3071eb6d6e99663, user_id=cace62d4c3374acca12a25d7542319b9, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:53.839213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:53.858413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 979/1961] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:53 2022] PUT /identity/v3/projects/1706eab7d2604687a3071eb6d6e99663/users/cace62d4c3374acca12a25d7542319b9/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:00:53.869274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557aaea-08b2-4457-be41-0a29c30f4584 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:53.869658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557aaea-08b2-4457-be41-0a29c30f4584 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:53.870023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557aaea-08b2-4457-be41-0a29c30f4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:53.914832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6557aaea-08b2-4457-be41-0a29c30f4584 None None] MFA Rules not processed for user `cace62d4c3374acca12a25d7542319b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:53.916434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6557aaea-08b2-4457-be41-0a29c30f4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:54.035344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 983/1962] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:54.049159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:54.051308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:54.127572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6374a2-4926-4d76-8669-f5552dc24258 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:54.131284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db457275-f861-4e52-9877-b7baa88364ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:54.133029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db457275-f861-4e52-9877-b7baa88364ed service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:54.133029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db457275-f861-4e52-9877-b7baa88364ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:54.133360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db457275-f861-4e52-9877-b7baa88364ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:54.146610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db457275-f861-4e52-9877-b7baa88364ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:54.149135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db457275-f861-4e52-9877-b7baa88364ed service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:54.160815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 980/1963] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:54.189190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557aaea-08b2-4457-be41-0a29c30f4584 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:54.317232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557aaea-08b2-4457-be41-0a29c30f4584 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:54.324794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:54.327939 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:54.328155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:54.328691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] PATH_INFO: `/v3/users/cace62d4c3374acca12a25d7542319b9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:54.336259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cace62d4c3374acca12a25d7542319b9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:54.340008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:54.419337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cace62d4c3374acca12a25d7542319b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:54.420839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cace62d4c3374acca12a25d7542319b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:54.431452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:54.434420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cace62d4c3374acca12a25d7542319b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:54.448796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cace62d4c3374acca12a25d7542319b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:54.450454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cace62d4c3374acca12a25d7542319b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:54.470772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 984/1964] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:00:54 2022] DELETE /identity/v3/users/cace62d4c3374acca12a25d7542319b9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:54.475608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2b0f-43f8-4574-9a0d-ea489311bede None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:54.476619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2b0f-43f8-4574-9a0d-ea489311bede None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:54.477083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2b0f-43f8-4574-9a0d-ea489311bede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:54.495829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-734c2b0f-43f8-4574-9a0d-ea489311bede None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:54.497088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-734c2b0f-43f8-4574-9a0d-ea489311bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:54.579296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 981/1965] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:54.589988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:54.591519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:54.670534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50531a-5c3a-49c6-ba34-c1ab3fb64c22 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:54.674592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96036ab5-3104-42e4-99ca-fb46e05120e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:54.675329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036ab5-3104-42e4-99ca-fb46e05120e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:54.675688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036ab5-3104-42e4-99ca-fb46e05120e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:54.676034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036ab5-3104-42e4-99ca-fb46e05120e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:54.687632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96036ab5-3104-42e4-99ca-fb46e05120e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:54.689098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96036ab5-3104-42e4-99ca-fb46e05120e0 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:54.701398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 985/1966] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:00:55.062138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c2b0f-43f8-4574-9a0d-ea489311bede None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:55.064314 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-734c2b0f-43f8-4574-9a0d-ea489311bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:55.080126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c2b0f-43f8-4574-9a0d-ea489311bede None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:55.086913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:55.088189 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.088481 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.088763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] PATH_INFO: `/v3/projects/1706eab7d2604687a3071eb6d6e99663` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.090247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1706eab7d2604687a3071eb6d6e99663)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:55.092325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:55.136138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:55.155527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1706eab7d2604687a3071eb6d6e99663', 'request_id': 'req-a0567106-cfff-4702-ae39-b8a4593f9459'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:55.164588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1706eab7d2604687a3071eb6d6e99663', 'request_id': 'req-a0567106-cfff-4702-ae39-b8a4593f9459'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:55.170504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1706eab7d2604687a3071eb6d6e99663', 'request_id': 'req-a0567106-cfff-4702-ae39-b8a4593f9459'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:55.183671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] The token cache is being invalidate because project 1706eab7d2604687a3071eb6d6e99663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:00:55.184088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:55.185236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a0567106-cfff-4702-ae39-b8a4593f9459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:00:55.187049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 982/1967] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:00:55 2022] DELETE /identity/v3/projects/1706eab7d2604687a3071eb6d6e99663 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:55.191852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383bcd-d598-457c-9e00-e4b9086d3564 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.192315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383bcd-d598-457c-9e00-e4b9086d3564 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.192401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383bcd-d598-457c-9e00-e4b9086d3564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.211122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-81383bcd-d598-457c-9e00-e4b9086d3564 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:55.212346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-81383bcd-d598-457c-9e00-e4b9086d3564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:55.286094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 986/1968] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:00:55.288001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfb28-323d-41c4-89b4-9b64a1db8698 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.288427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfb28-323d-41c4-89b4-9b64a1db8698 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.288803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfb28-323d-41c4-89b4-9b64a1db8698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.310336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2bdbfb28-323d-41c4-89b4-9b64a1db8698 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:55.311492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2bdbfb28-323d-41c4-89b4-9b64a1db8698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:55.321139 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 983/1969] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:55.325499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383bcd-d598-457c-9e00-e4b9086d3564 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:55.335459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383bcd-d598-457c-9e00-e4b9086d3564 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:55.341349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:55.342067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.342863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.343155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.343910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:00:55.344801 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:55.347444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:55.364222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 987/1970] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:00:55.369207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbfb28-323d-41c4-89b4-9b64a1db8698 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:55.380599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbfb28-323d-41c4-89b4-9b64a1db8698 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:55.388606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d41e40-88bd-49b7-bd61-71b3b324e3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:55.389302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41e40-88bd-49b7-bd61-71b3b324e3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.389621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41e40-88bd-49b7-bd61-71b3b324e3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.389913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41e40-88bd-49b7-bd61-71b3b324e3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.391476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d41e40-88bd-49b7-bd61-71b3b324e3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:55.394537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d41e40-88bd-49b7-bd61-71b3b324e3b9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:55.440833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 984/1971] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:00:55 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:00:55.445090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:55.456372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26df4a-90fc-4eb3-b401-4d946c56ef30 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:55.520951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58fa34-ceb5-4b4e-a0d0-524c2e0501c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:55.521786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fa34-ceb5-4b4e-a0d0-524c2e0501c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.522594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fa34-ceb5-4b4e-a0d0-524c2e0501c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.522958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fa34-ceb5-4b4e-a0d0-524c2e0501c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.523739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58fa34-ceb5-4b4e-a0d0-524c2e0501c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:55.525569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58fa34-ceb5-4b4e-a0d0-524c2e0501c8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:55.532429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:00:55.552338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 988/1972] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:00:55 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:00:55.553835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d41e40-88bd-49b7-bd61-71b3b324e3b9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:55.564493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d41e40-88bd-49b7-bd61-71b3b324e3b9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:55.570875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4129d3c-fedb-428e-b3e8-3ad36c9b55bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:55.571572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129d3c-fedb-428e-b3e8-3ad36c9b55bd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.571862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129d3c-fedb-428e-b3e8-3ad36c9b55bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.572494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129d3c-fedb-428e-b3e8-3ad36c9b55bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.573932 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4129d3c-fedb-428e-b3e8-3ad36c9b55bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:55.575725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4129d3c-fedb-428e-b3e8-3ad36c9b55bd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:55.590571 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 985/1973] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:55.591781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58fa34-ceb5-4b4e-a0d0-524c2e0501c8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:55.601841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58fa34-ceb5-4b4e-a0d0-524c2e0501c8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:55.607023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301a2c-4348-44e9-a0a9-dc878be2555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:55.607721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301a2c-4348-44e9-a0a9-dc878be2555b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.608008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301a2c-4348-44e9-a0a9-dc878be2555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.608289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301a2c-4348-44e9-a0a9-dc878be2555b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.609021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301a2c-4348-44e9-a0a9-dc878be2555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:55.610649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301a2c-4348-44e9-a0a9-dc878be2555b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:55.625679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 989/1974] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:00:55.627505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4129d3c-fedb-428e-b3e8-3ad36c9b55bd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:55.639443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4129d3c-fedb-428e-b3e8-3ad36c9b55bd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:55.644853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:55.645807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.646098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.646387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] PATH_INFO: `/v3/projects/f82207c7eca1428380038b610412d80f/users/c0d085ae32b144e8ad6432d2ae9eb008/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.663614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82207c7eca1428380038b610412d80f, user_id=c0d085ae32b144e8ad6432d2ae9eb008, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:55.666405 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:55.680651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 986/1975] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:00:55 2022] PUT /identity/v3/projects/f82207c7eca1428380038b610412d80f/users/c0d085ae32b144e8ad6432d2ae9eb008/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:00:55.691724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c058-8405-4dee-84f9-43704f23bb9a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.692101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c058-8405-4dee-84f9-43704f23bb9a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.692393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c058-8405-4dee-84f9-43704f23bb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.723715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6cf9c058-8405-4dee-84f9-43704f23bb9a None None] MFA Rules not processed for user `c0d085ae32b144e8ad6432d2ae9eb008`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:00:55.725085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6cf9c058-8405-4dee-84f9-43704f23bb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:55.814055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 990/1976] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:00:55.821899 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:00:55.823755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:00:55.898027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4c89f-0138-4c9f-98d9-9f941596dc0a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:00:55.905394 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bf909-522d-41c9-981b-b961cf205993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:00:55.906599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf909-522d-41c9-981b-b961cf205993 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:00:55.907094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf909-522d-41c9-981b-b961cf205993 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:00:55.907599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf909-522d-41c9-981b-b961cf205993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:00:55.920159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bf909-522d-41c9-981b-b961cf205993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:00:55.921661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bf909-522d-41c9-981b-b961cf205993 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:00:55.932813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 987/1977] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:05.805635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:05.928708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:18.644843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c86b-4c27-4693-94b5-678b8d87e4d7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:18.645452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c86b-4c27-4693-94b5-678b8d87e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:18.645452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c86b-4c27-4693-94b5-678b8d87e4d7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:18.646930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 991/1978] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:01:18.656951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee80a-c425-44c6-9ab7-6b5bc3bab849 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:18.657485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee80a-c425-44c6-9ab7-6b5bc3bab849 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:18.657617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee80a-c425-44c6-9ab7-6b5bc3bab849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:18.679584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ae8ee80a-c425-44c6-9ab7-6b5bc3bab849 None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:18.680738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae8ee80a-c425-44c6-9ab7-6b5bc3bab849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:18.718286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c86b-4c27-4693-94b5-678b8d87e4d7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:18.720145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b579c86b-4c27-4693-94b5-678b8d87e4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:18.751906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 988/1979] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:18.763556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee80a-c425-44c6-9ab7-6b5bc3bab849 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:18.764947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae8ee80a-c425-44c6-9ab7-6b5bc3bab849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:18.777814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee80a-c425-44c6-9ab7-6b5bc3bab849 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:18.782885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495511d-a432-46b3-a204-63aa75c5786d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:18.783541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495511d-a432-46b3-a204-63aa75c5786d service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:18.783835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495511d-a432-46b3-a204-63aa75c5786d service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:18.784122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495511d-a432-46b3-a204-63aa75c5786d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:18.792279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c86b-4c27-4693-94b5-678b8d87e4d7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:18.793592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495511d-a432-46b3-a204-63aa75c5786d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:18.795213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495511d-a432-46b3-a204-63aa75c5786d service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:18.796893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:18.797801 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:18.798093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:18.798377 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] PATH_INFO: `/v3/users/b17c2e04df574107958a6c067957b44e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:18.799593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17c2e04df574107958a6c067957b44e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:18.801598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:18.805599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 989/1980] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:01:18.846778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495511d-a432-46b3-a204-63aa75c5786d service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:18.854191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17c2e04df574107958a6c067957b44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.854874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17c2e04df574107958a6c067957b44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.858122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495511d-a432-46b3-a204-63aa75c5786d service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:18.861875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17c2e04df574107958a6c067957b44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.863627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:18.864513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:18.865494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:18.865974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] PATH_INFO: `/v3/users/c0d085ae32b144e8ad6432d2ae9eb008` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:18.867304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d085ae32b144e8ad6432d2ae9eb008)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:18.869846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:18.871067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17c2e04df574107958a6c067957b44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.871785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e995ae76-6f0a-426d-8972-26a3f70ec376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17c2e04df574107958a6c067957b44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.890703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 992/1981] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:18 2022] DELETE /identity/v3/users/b17c2e04df574107958a6c067957b44e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:18.919329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d085ae32b144e8ad6432d2ae9eb008'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.920127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d085ae32b144e8ad6432d2ae9eb008'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.928164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d085ae32b144e8ad6432d2ae9eb008'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.948323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d085ae32b144e8ad6432d2ae9eb008'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.959458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d085ae32b144e8ad6432d2ae9eb008'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:18.967594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 990/1982] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:18 2022] DELETE /identity/v3/users/c0d085ae32b144e8ad6432d2ae9eb008 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:18.972562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda183df-d207-4ac7-aa79-05475b05967e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:18.972791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda183df-d207-4ac7-aa79-05475b05967e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:18.973080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda183df-d207-4ac7-aa79-05475b05967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:18.996690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dda183df-d207-4ac7-aa79-05475b05967e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:18.997990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dda183df-d207-4ac7-aa79-05475b05967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:19.067239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 993/1983] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:19.077701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.079624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:19.158322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aafa4-f614-430a-a1fe-33610e8c711e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.164109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cf46-b59a-4152-afb7-9cf6a4b89de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.164854 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cf46-b59a-4152-afb7-9cf6a4b89de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.165280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cf46-b59a-4152-afb7-9cf6a4b89de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.165584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cf46-b59a-4152-afb7-9cf6a4b89de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.174031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda183df-d207-4ac7-aa79-05475b05967e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.177687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dda183df-d207-4ac7-aa79-05475b05967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:19.184385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079cf46-b59a-4152-afb7-9cf6a4b89de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.186426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079cf46-b59a-4152-afb7-9cf6a4b89de4 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:19.194942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:19.214458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda183df-d207-4ac7-aa79-05475b05967e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.223106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.224097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.224608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.225064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] PATH_INFO: `/v3/projects/01df0d2de51e466f86ba6b8736b4b32e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.226381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 991/1984] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:19.230333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01df0d2de51e466f86ba6b8736b4b32e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.233957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:19.260264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:19.315639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01df0d2de51e466f86ba6b8736b4b32e', 'request_id': 'req-63dfb262-675c-4234-bf6c-536908870e49'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.324898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01df0d2de51e466f86ba6b8736b4b32e', 'request_id': 'req-63dfb262-675c-4234-bf6c-536908870e49'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.338636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01df0d2de51e466f86ba6b8736b4b32e', 'request_id': 'req-63dfb262-675c-4234-bf6c-536908870e49'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.359167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] The token cache is being invalidate because project 01df0d2de51e466f86ba6b8736b4b32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:19.359585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.360848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63dfb262-675c-4234-bf6c-536908870e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.363830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 994/1985] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:19 2022] DELETE /identity/v3/projects/01df0d2de51e466f86ba6b8736b4b32e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:19.369720 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed93691-5304-4ca3-9575-a0e95f8e122b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.369949 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed93691-5304-4ca3-9575-a0e95f8e122b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.370295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed93691-5304-4ca3-9575-a0e95f8e122b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.399864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5ed93691-5304-4ca3-9575-a0e95f8e122b None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:19.401612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5ed93691-5304-4ca3-9575-a0e95f8e122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:19.496090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 992/1986] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:19.504292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae8fd-5bc9-4e64-be08-d6fbef3ae8bc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.504587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae8fd-5bc9-4e64-be08-d6fbef3ae8bc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.504873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae8fd-5bc9-4e64-be08-d6fbef3ae8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.538384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-184ae8fd-5bc9-4e64-be08-d6fbef3ae8bc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:19.539973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-184ae8fd-5bc9-4e64-be08-d6fbef3ae8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:19.550368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 995/1987] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:01:19.554346 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed93691-5304-4ca3-9575-a0e95f8e122b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.576174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed93691-5304-4ca3-9575-a0e95f8e122b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.579316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ae8fd-5bc9-4e64-be08-d6fbef3ae8bc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.581778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-184ae8fd-5bc9-4e64-be08-d6fbef3ae8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:19.582408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.583152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.583417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.584567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.585942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:01:19.586197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.588007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:19.604738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 993/1988] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:01:19.605659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ae8fd-5bc9-4e64-be08-d6fbef3ae8bc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.610661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.612906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.613865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.614271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.614670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] PATH_INFO: `/v3/projects/f82207c7eca1428380038b610412d80f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.618567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82207c7eca1428380038b610412d80f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.621883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:19.624230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0b2b-e9d7-4e3f-ae4d-6f39b04f7bcc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.629512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa015e-d446-4f4f-8b07-7190b8305bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.630220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa015e-d446-4f4f-8b07-7190b8305bea admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.631447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa015e-d446-4f4f-8b07-7190b8305bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.631951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa015e-d446-4f4f-8b07-7190b8305bea admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.632729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa015e-d446-4f4f-8b07-7190b8305bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.634751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa015e-d446-4f4f-8b07-7190b8305bea admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:19.668981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 994/1989] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:19 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:19.673375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa015e-d446-4f4f-8b07-7190b8305bea admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.684674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82207c7eca1428380038b610412d80f', 'request_id': 'req-023edca3-783a-4c3c-8d9a-f489b64e9d20'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.691218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82207c7eca1428380038b610412d80f', 'request_id': 'req-023edca3-783a-4c3c-8d9a-f489b64e9d20'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.701871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82207c7eca1428380038b610412d80f', 'request_id': 'req-023edca3-783a-4c3c-8d9a-f489b64e9d20'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.716117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] The token cache is being invalidate because project f82207c7eca1428380038b610412d80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:19.716544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.717330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:19.719074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 996/1990] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:19 2022] DELETE /identity/v3/projects/f82207c7eca1428380038b610412d80f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:19.754010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa015e-d446-4f4f-8b07-7190b8305bea admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.760591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d75aa-0f9c-4cbb-8ff0-f806d90b87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.761587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d75aa-0f9c-4cbb-8ff0-f806d90b87fc admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.761881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d75aa-0f9c-4cbb-8ff0-f806d90b87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.762170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d75aa-0f9c-4cbb-8ff0-f806d90b87fc admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.762953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d75aa-0f9c-4cbb-8ff0-f806d90b87fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.765052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d75aa-0f9c-4cbb-8ff0-f806d90b87fc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:19.786952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 995/1991] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:19 2022] POST /identity/v3/users => generated 282 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:19.791898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.793530 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:19.892571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023edca3-783a-4c3c-8d9a-f489b64e9d20 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.898631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9d69d-529a-4833-8a08-5117cc9a0906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.899335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9d69d-529a-4833-8a08-5117cc9a0906 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.899634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9d69d-529a-4833-8a08-5117cc9a0906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.899918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9d69d-529a-4833-8a08-5117cc9a0906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.900659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9d69d-529a-4833-8a08-5117cc9a0906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.902340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9d69d-529a-4833-8a08-5117cc9a0906 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:19.918412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 997/1992] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:19.919865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d75aa-0f9c-4cbb-8ff0-f806d90b87fc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.931545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d75aa-0f9c-4cbb-8ff0-f806d90b87fc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.937190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bdd85-c6cb-4095-96f7-b37726f7488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.938182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bdd85-c6cb-4095-96f7-b37726f7488e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.938480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bdd85-c6cb-4095-96f7-b37726f7488e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.938760 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bdd85-c6cb-4095-96f7-b37726f7488e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.939527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bdd85-c6cb-4095-96f7-b37726f7488e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.941138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bdd85-c6cb-4095-96f7-b37726f7488e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:19.952800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 996/1993] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:19.956945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9d69d-529a-4833-8a08-5117cc9a0906 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:19.967656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9d69d-529a-4833-8a08-5117cc9a0906 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:19.972332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f3d65-1752-488e-b110-2591dbd787a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:19.973217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f3d65-1752-488e-b110-2591dbd787a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:19.973506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f3d65-1752-488e-b110-2591dbd787a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:19.973822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f3d65-1752-488e-b110-2591dbd787a2 admin admin] PATH_INFO: `/v3/projects/737818e2aaf449b4b5ded55f967bf253/users/3c0e73b6075848629d4d2ae5d0de1ea4/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:19.986390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:19.989736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f3d65-1752-488e-b110-2591dbd787a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737818e2aaf449b4b5ded55f967bf253, user_id=3c0e73b6075848629d4d2ae5d0de1ea4, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:19.994068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f3d65-1752-488e-b110-2591dbd787a2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.007960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 998/1994] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:19 2022] PUT /identity/v3/projects/737818e2aaf449b4b5ded55f967bf253/users/3c0e73b6075848629d4d2ae5d0de1ea4/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:20.018020 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ca1a-aab9-46c5-8f8b-9cad833cf66f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.018333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ca1a-aab9-46c5-8f8b-9cad833cf66f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.018609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ca1a-aab9-46c5-8f8b-9cad833cf66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.045309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-25c9ca1a-aab9-46c5-8f8b-9cad833cf66f None None] MFA Rules not processed for user `3c0e73b6075848629d4d2ae5d0de1ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:20.046559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-25c9ca1a-aab9-46c5-8f8b-9cad833cf66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:20.077852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:20.114294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 997/1995] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:20.119968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f3d65-1752-488e-b110-2591dbd787a2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.183537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f3d65-1752-488e-b110-2591dbd787a2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.188783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cdafa-41f4-4b7c-a315-e15ab87fa2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.189459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdafa-41f4-4b7c-a315-e15ab87fa2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.189780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdafa-41f4-4b7c-a315-e15ab87fa2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.190066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdafa-41f4-4b7c-a315-e15ab87fa2d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.192963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cdafa-41f4-4b7c-a315-e15ab87fa2d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.192963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cdafa-41f4-4b7c-a315-e15ab87fa2d5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.221519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 999/1996] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:20 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:01:20.226052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9ca1a-aab9-46c5-8f8b-9cad833cf66f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.236924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9ca1a-aab9-46c5-8f8b-9cad833cf66f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.295612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5ed63-b4bc-46f7-a3b7-0cf8bf7ea009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.296547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ed63-b4bc-46f7-a3b7-0cf8bf7ea009 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.297018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ed63-b4bc-46f7-a3b7-0cf8bf7ea009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.297307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ed63-b4bc-46f7-a3b7-0cf8bf7ea009 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.298044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5ed63-b4bc-46f7-a3b7-0cf8bf7ea009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.300013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5ed63-b4bc-46f7-a3b7-0cf8bf7ea009 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.324838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 998/1997] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:20 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:20.326080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cdafa-41f4-4b7c-a315-e15ab87fa2d5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.338111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cdafa-41f4-4b7c-a315-e15ab87fa2d5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.343206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7991793-2027-4b42-ba94-ff3f56a83cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.343962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7991793-2027-4b42-ba94-ff3f56a83cae admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.344262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7991793-2027-4b42-ba94-ff3f56a83cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.344551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7991793-2027-4b42-ba94-ff3f56a83cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.345287 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7991793-2027-4b42-ba94-ff3f56a83cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.346923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7991793-2027-4b42-ba94-ff3f56a83cae admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.359383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1000/1998] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:20.362068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5ed63-b4bc-46f7-a3b7-0cf8bf7ea009 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.373144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5ed63-b4bc-46f7-a3b7-0cf8bf7ea009 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.377821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949800-35e4-4772-8107-e485c9bcddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.378707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949800-35e4-4772-8107-e485c9bcddaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.379024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949800-35e4-4772-8107-e485c9bcddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.379306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949800-35e4-4772-8107-e485c9bcddaa admin admin] PATH_INFO: `/v3/projects/450cb782744b40078859228d6a49e7db/users/4b899cc067854420aa7005e591bef747/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.395161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b949800-35e4-4772-8107-e485c9bcddaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=450cb782744b40078859228d6a49e7db, user_id=4b899cc067854420aa7005e591bef747, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.398335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b949800-35e4-4772-8107-e485c9bcddaa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.419080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 999/1999] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:20 2022] PUT /identity/v3/projects/450cb782744b40078859228d6a49e7db/users/4b899cc067854420aa7005e591bef747/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:20.425754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7991793-2027-4b42-ba94-ff3f56a83cae admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.437789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7991793-2027-4b42-ba94-ff3f56a83cae admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.501688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d966b23-e23c-4dfd-861d-c52f381666d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.502367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d966b23-e23c-4dfd-861d-c52f381666d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.502653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d966b23-e23c-4dfd-861d-c52f381666d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.502931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d966b23-e23c-4dfd-861d-c52f381666d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.503665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d966b23-e23c-4dfd-861d-c52f381666d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.505240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d966b23-e23c-4dfd-861d-c52f381666d4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.523065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1001/2000] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:01:20.524766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949800-35e4-4772-8107-e485c9bcddaa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.535217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949800-35e4-4772-8107-e485c9bcddaa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.540466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.541427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.541810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.542168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] PATH_INFO: `/v3/projects/450cb782744b40078859228d6a49e7db/users/4b899cc067854420aa7005e591bef747/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.544221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=450cb782744b40078859228d6a49e7db, user_id=4b899cc067854420aa7005e591bef747, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.546894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.558974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1000/2001] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:20 2022] PUT /identity/v3/projects/450cb782744b40078859228d6a49e7db/users/4b899cc067854420aa7005e591bef747/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:20.570549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193377-8bdc-4572-804c-454103550bb4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.570860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193377-8bdc-4572-804c-454103550bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.571162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193377-8bdc-4572-804c-454103550bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.599032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-03193377-8bdc-4572-804c-454103550bb4 None None] MFA Rules not processed for user `4b899cc067854420aa7005e591bef747`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:20.600699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-03193377-8bdc-4572-804c-454103550bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:20.653568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:20.676533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1002/2002] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:20.688983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.690813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:20.741876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193377-8bdc-4572-804c-454103550bb4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.743655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-03193377-8bdc-4572-804c-454103550bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:20.756610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525104d-9d50-4eeb-bdec-219db03d4d9e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.762172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323919d1-240d-4684-820a-22cbf9001a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.762843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323919d1-240d-4684-820a-22cbf9001a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.763137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323919d1-240d-4684-820a-22cbf9001a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.763423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323919d1-240d-4684-820a-22cbf9001a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.773222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323919d1-240d-4684-820a-22cbf9001a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.774724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323919d1-240d-4684-820a-22cbf9001a58 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.785500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1001/2003] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:20.817627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193377-8bdc-4572-804c-454103550bb4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.825501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.826519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.826750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.827000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] PATH_INFO: `/v3/users/8033524eb8924495839e2efc1f9e92d2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.828779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8033524eb8924495839e2efc1f9e92d2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.831202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.886982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8033524eb8924495839e2efc1f9e92d2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:20.887671 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8033524eb8924495839e2efc1f9e92d2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:20.888072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323919d1-240d-4684-820a-22cbf9001a58 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:20.894769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8033524eb8924495839e2efc1f9e92d2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:20.896675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323919d1-240d-4684-820a-22cbf9001a58 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:20.901281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:20.901961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.902424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.902628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8033524eb8924495839e2efc1f9e92d2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:20.902744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.903387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0f7b0f0d-258e-42e5-8e49-2f6416a40091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8033524eb8924495839e2efc1f9e92d2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:20.904529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:20.922673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1003/2004] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:20 2022] DELETE /identity/v3/users/8033524eb8924495839e2efc1f9e92d2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:20.928094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a55e9-43e9-4f76-b467-7a8e11ba57a0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:20.928597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a55e9-43e9-4f76-b467-7a8e11ba57a0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:20.929027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a55e9-43e9-4f76-b467-7a8e11ba57a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:20.931715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:20.946522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-945a55e9-43e9-4f76-b467-7a8e11ba57a0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:20.947737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-945a55e9-43e9-4f76-b467-7a8e11ba57a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:20.967138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:20.969214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:20.980171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1002/2005] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:01:21.012152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1004/2006] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:01:21.022024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:21.023464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:21.090990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10b622-5e6b-4d8e-8f2c-ddc849053da8 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:21.148934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e1ca0-9d41-4b7a-9599-8d1b370d9a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:21.149874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1ca0-9d41-4b7a-9599-8d1b370d9a93 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:21.150499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1ca0-9d41-4b7a-9599-8d1b370d9a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:21.150782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1ca0-9d41-4b7a-9599-8d1b370d9a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:21.160452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e1ca0-9d41-4b7a-9599-8d1b370d9a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:21.162220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e1ca0-9d41-4b7a-9599-8d1b370d9a93 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:21.171960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1003/2007] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:21.503193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a55e9-43e9-4f76-b467-7a8e11ba57a0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:21.504601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-945a55e9-43e9-4f76-b467-7a8e11ba57a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:21.516500 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a55e9-43e9-4f76-b467-7a8e11ba57a0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:21.522766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:21.523897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:21.523996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:21.524196 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] PATH_INFO: `/v3/projects/e785e9fecbe344dea1556ecc08a4cf37` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:21.525763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e785e9fecbe344dea1556ecc08a4cf37)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:21.540256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:21.542582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:21.592512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e785e9fecbe344dea1556ecc08a4cf37', 'request_id': 'req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.598599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e785e9fecbe344dea1556ecc08a4cf37', 'request_id': 'req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.606209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e785e9fecbe344dea1556ecc08a4cf37', 'request_id': 'req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.617428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] The token cache is being invalidate because project e785e9fecbe344dea1556ecc08a4cf37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:21.617893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.618800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-67ed26c1-fa0e-4ad3-9517-10bceb1db54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.620383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1005/2008] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:21 2022] DELETE /identity/v3/projects/e785e9fecbe344dea1556ecc08a4cf37 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:21.626535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2689-a148-45c0-bfe8-333b4d97fcc2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:21.626833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2689-a148-45c0-bfe8-333b4d97fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:21.627121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2689-a148-45c0-bfe8-333b4d97fcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:21.645521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-891e2689-a148-45c0-bfe8-333b4d97fcc2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:21.646918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-891e2689-a148-45c0-bfe8-333b4d97fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:21.714685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1004/2009] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:21.723238 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb8c2-34d3-4833-a08b-223a9b33990a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:21.723536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb8c2-34d3-4833-a08b-223a9b33990a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:21.723822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb8c2-34d3-4833-a08b-223a9b33990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:21.742791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a7feb8c2-34d3-4833-a08b-223a9b33990a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:21.744258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a7feb8c2-34d3-4833-a08b-223a9b33990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:21.752737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1006/2010] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:21.752876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2689-a148-45c0-bfe8-333b4d97fcc2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:21.754440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-891e2689-a148-45c0-bfe8-333b4d97fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:21.757337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb8c2-34d3-4833-a08b-223a9b33990a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:21.766640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb8c2-34d3-4833-a08b-223a9b33990a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:21.767885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2689-a148-45c0-bfe8-333b4d97fcc2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:21.772444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:21.772965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:21.773253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:21.773537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:21.773663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:21.774295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:01:21.774510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:21.774609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:21.774796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:21.775097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] PATH_INFO: `/v3/users/19c356da1eb9449cb8477dbf13fea7d5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:21.776204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:21.776303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c356da1eb9449cb8477dbf13fea7d5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:21.778341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:21.788301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1007/2011] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:01:21.792564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:21.800743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:21.802315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480234e6-d460-43a2-af48-4999f878d66d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:21.808727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:21.809534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:21.809853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:21.810135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:21.810862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:21.813305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:21.829563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c356da1eb9449cb8477dbf13fea7d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.830305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c356da1eb9449cb8477dbf13fea7d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.838506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c356da1eb9449cb8477dbf13fea7d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.845309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1008/2012] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:21 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:01:21.846330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:21.847935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:21.851647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c356da1eb9449cb8477dbf13fea7d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.858670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e990014b-bb49-4d7b-afd6-8c2b5f2c8b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c356da1eb9449cb8477dbf13fea7d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:21.865303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1005/2013] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:21 2022] DELETE /identity/v3/users/19c356da1eb9449cb8477dbf13fea7d5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:21.869836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c717f6-2344-4a41-8390-77dcf92b1f4f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:21.870136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c717f6-2344-4a41-8390-77dcf92b1f4f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:21.870429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c717f6-2344-4a41-8390-77dcf92b1f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:21.887499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c5c717f6-2344-4a41-8390-77dcf92b1f4f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:21.888929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c5c717f6-2344-4a41-8390-77dcf92b1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:21.933719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6272f22-e17e-4eb8-b892-a9b86cc7c6d2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:21.976594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1006/2014] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:01:21.986344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c717f6-2344-4a41-8390-77dcf92b1f4f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:21.988114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c5c717f6-2344-4a41-8390-77dcf92b1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:21.996985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:22.006421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce5de-95e8-4097-869d-e9486ec08296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.007498 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce5de-95e8-4097-869d-e9486ec08296 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.007933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce5de-95e8-4097-869d-e9486ec08296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.008446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce5de-95e8-4097-869d-e9486ec08296 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.009501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ce5de-95e8-4097-869d-e9486ec08296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.011674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ce5de-95e8-4097-869d-e9486ec08296 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.033818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1009/2015] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:21 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:22.039225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce5de-95e8-4097-869d-e9486ec08296 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:22.048920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce5de-95e8-4097-869d-e9486ec08296 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:22.054561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb101088-3616-4de2-bb64-17c6ecfc401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.055230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101088-3616-4de2-bb64-17c6ecfc401e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.055364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c717f6-2344-4a41-8390-77dcf92b1f4f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:22.055514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101088-3616-4de2-bb64-17c6ecfc401e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.055792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101088-3616-4de2-bb64-17c6ecfc401e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.056523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb101088-3616-4de2-bb64-17c6ecfc401e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.058182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb101088-3616-4de2-bb64-17c6ecfc401e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.059072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b3c6c-b92a-4389-801a-142900f4e791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.059729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b3c6c-b92a-4389-801a-142900f4e791 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.060021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b3c6c-b92a-4389-801a-142900f4e791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.060304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b3c6c-b92a-4389-801a-142900f4e791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.069073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1010/2016] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:01:22.070353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b3c6c-b92a-4389-801a-142900f4e791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.072032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b3c6c-b92a-4389-801a-142900f4e791 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.072925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb101088-3616-4de2-bb64-17c6ecfc401e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:22.082242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb101088-3616-4de2-bb64-17c6ecfc401e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:22.082478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1007/2017] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:01:22.089027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be6f5c-3dec-4fbe-916a-89fb53fcc3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.089779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be6f5c-3dec-4fbe-916a-89fb53fcc3de admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.090073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be6f5c-3dec-4fbe-916a-89fb53fcc3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.090365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be6f5c-3dec-4fbe-916a-89fb53fcc3de admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.091107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be6f5c-3dec-4fbe-916a-89fb53fcc3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.092726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be6f5c-3dec-4fbe-916a-89fb53fcc3de admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.104296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1011/2018] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:01:22.108474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b3c6c-b92a-4389-801a-142900f4e791 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:22.118731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b3c6c-b92a-4389-801a-142900f4e791 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:22.125382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.126249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.126541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.126825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] PATH_INFO: `/v3/projects/1bff61a2fe6545e9b39f0fc18dcdca50/users/663ebe705a1c46e5a441cd7210d31022/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.144207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bff61a2fe6545e9b39f0fc18dcdca50, user_id=663ebe705a1c46e5a441cd7210d31022, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.148301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.162996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1008/2019] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:22 2022] PUT /identity/v3/projects/1bff61a2fe6545e9b39f0fc18dcdca50/users/663ebe705a1c46e5a441cd7210d31022/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:22.173884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280bb86-d6ba-470d-ba86-7a5abb49ced6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.174477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280bb86-d6ba-470d-ba86-7a5abb49ced6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.174772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280bb86-d6ba-470d-ba86-7a5abb49ced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.206398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8280bb86-d6ba-470d-ba86-7a5abb49ced6 None None] MFA Rules not processed for user `663ebe705a1c46e5a441cd7210d31022`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:22.207659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8280bb86-d6ba-470d-ba86-7a5abb49ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:22.291139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1012/2020] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:22.303876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:22.307860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:22.328759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:22.381482 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a1cc0-0135-45cf-aa5e-fe8ab71bd357 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:22.386363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3396b9-4203-4ee6-89ba-a2288d67b45c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.387056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3396b9-4203-4ee6-89ba-a2288d67b45c service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.387409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3396b9-4203-4ee6-89ba-a2288d67b45c service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.387787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3396b9-4203-4ee6-89ba-a2288d67b45c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.399519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3396b9-4203-4ee6-89ba-a2288d67b45c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.401137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3396b9-4203-4ee6-89ba-a2288d67b45c service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.420910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1009/2021] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:22.432239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280bb86-d6ba-470d-ba86-7a5abb49ced6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:22.433842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8280bb86-d6ba-470d-ba86-7a5abb49ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:22.529330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280bb86-d6ba-470d-ba86-7a5abb49ced6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:22.534306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.535156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.535447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.535731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] PATH_INFO: `/v3/projects/dced7a5062494e2ca9da92bda728f9a7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.537962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dced7a5062494e2ca9da92bda728f9a7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.539996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.615495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dced7a5062494e2ca9da92bda728f9a7', 'request_id': 'req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:22.623638 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dced7a5062494e2ca9da92bda728f9a7', 'request_id': 'req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:22.627286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:22.636984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dced7a5062494e2ca9da92bda728f9a7', 'request_id': 'req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:22.657311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] The token cache is being invalidate because project dced7a5062494e2ca9da92bda728f9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:22.657650 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:22.658808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59f7e4dc-a249-411c-bdb9-2cba0d7d5606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:22.661413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1013/2022] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:22 2022] DELETE /identity/v3/projects/dced7a5062494e2ca9da92bda728f9a7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:22.666862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d777ab-4814-454e-85db-aa2916cdeb52 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.668044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d777ab-4814-454e-85db-aa2916cdeb52 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.668526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d777ab-4814-454e-85db-aa2916cdeb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.690167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-95d777ab-4814-454e-85db-aa2916cdeb52 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:22.691398 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-95d777ab-4814-454e-85db-aa2916cdeb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:22.772818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1010/2023] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:22.781702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f811-8ea3-4936-b258-1529dd1f9c49 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.782167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f811-8ea3-4936-b258-1529dd1f9c49 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.782324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f811-8ea3-4936-b258-1529dd1f9c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.812192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8822f811-8ea3-4936-b258-1529dd1f9c49 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:22.813381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8822f811-8ea3-4936-b258-1529dd1f9c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:22.822323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1014/2024] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:22.826567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d777ab-4814-454e-85db-aa2916cdeb52 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:22.838000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d777ab-4814-454e-85db-aa2916cdeb52 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:22.843345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.844010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.844298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.844580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.845313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:01:22.845762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.847277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.867995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1011/2025] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:01:22.870016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822f811-8ea3-4936-b258-1529dd1f9c49 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:22.882083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822f811-8ea3-4936-b258-1529dd1f9c49 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:22.887131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511671bc-4d69-4ba8-8e7a-e85fd665061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:22.888115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511671bc-4d69-4ba8-8e7a-e85fd665061a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:22.888481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511671bc-4d69-4ba8-8e7a-e85fd665061a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:22.888840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511671bc-4d69-4ba8-8e7a-e85fd665061a admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:22.889668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511671bc-4d69-4ba8-8e7a-e85fd665061a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:22.891742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511671bc-4d69-4ba8-8e7a-e85fd665061a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:22.926295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1015/2026] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:22 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:22.928277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:22.941445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475c174-896a-4c03-814c-640e6192a6aa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.009963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf802-828e-4d58-8846-051ae52633b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.010673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf802-828e-4d58-8846-051ae52633b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.010987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf802-828e-4d58-8846-051ae52633b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.011272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf802-828e-4d58-8846-051ae52633b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.011977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf802-828e-4d58-8846-051ae52633b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.013972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf802-828e-4d58-8846-051ae52633b1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.033667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1012/2027] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:22 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:23.038294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511671bc-4d69-4ba8-8e7a-e85fd665061a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.050722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511671bc-4d69-4ba8-8e7a-e85fd665061a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.056779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9c5f-a8ff-4345-9331-1c58c54ebeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.057631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9c5f-a8ff-4345-9331-1c58c54ebeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.057914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9c5f-a8ff-4345-9331-1c58c54ebeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.058201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9c5f-a8ff-4345-9331-1c58c54ebeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.058996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a9c5f-a8ff-4345-9331-1c58c54ebeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.060609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a9c5f-a8ff-4345-9331-1c58c54ebeb0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.071715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1016/2028] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:23.075772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf802-828e-4d58-8846-051ae52633b1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.086148 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf802-828e-4d58-8846-051ae52633b1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.090730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cb480-64d2-4085-9224-dd3aebb75327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.091883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb480-64d2-4085-9224-dd3aebb75327 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.092172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb480-64d2-4085-9224-dd3aebb75327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.092451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb480-64d2-4085-9224-dd3aebb75327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.093173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cb480-64d2-4085-9224-dd3aebb75327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.094817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cb480-64d2-4085-9224-dd3aebb75327 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.105683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1013/2029] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:23.109739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9c5f-a8ff-4345-9331-1c58c54ebeb0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.120689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9c5f-a8ff-4345-9331-1c58c54ebeb0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.125337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eaac3-9506-407c-b2eb-e2b699393a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.126271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eaac3-9506-407c-b2eb-e2b699393a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.126563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eaac3-9506-407c-b2eb-e2b699393a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.126850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eaac3-9506-407c-b2eb-e2b699393a11 admin admin] PATH_INFO: `/v3/projects/6824f1af8fca44fab8ed5c97220360ee/users/e0ba2752520e4745840e0edff7d7ad30/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.141799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7eaac3-9506-407c-b2eb-e2b699393a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6824f1af8fca44fab8ed5c97220360ee, user_id=e0ba2752520e4745840e0edff7d7ad30, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.145062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7eaac3-9506-407c-b2eb-e2b699393a11 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.159085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1017/2030] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:23 2022] PUT /identity/v3/projects/6824f1af8fca44fab8ed5c97220360ee/users/e0ba2752520e4745840e0edff7d7ad30/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:23.170292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9bbe9-6de2-4fbd-acc3-a6e73486b6dd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.170599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9bbe9-6de2-4fbd-acc3-a6e73486b6dd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.170882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9bbe9-6de2-4fbd-acc3-a6e73486b6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.199464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-69c9bbe9-6de2-4fbd-acc3-a6e73486b6dd None None] MFA Rules not processed for user `e0ba2752520e4745840e0edff7d7ad30`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:23.200670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-69c9bbe9-6de2-4fbd-acc3-a6e73486b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:23.212558 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:23.274133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1014/2031] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:23.278668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eaac3-9506-407c-b2eb-e2b699393a11 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.343812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eaac3-9506-407c-b2eb-e2b699393a11 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.348312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4d1e0-1da5-46ee-9fbe-14b46d74900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.348968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d1e0-1da5-46ee-9fbe-14b46d74900d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.350020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d1e0-1da5-46ee-9fbe-14b46d74900d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.350558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d1e0-1da5-46ee-9fbe-14b46d74900d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.351862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4d1e0-1da5-46ee-9fbe-14b46d74900d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.353363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4d1e0-1da5-46ee-9fbe-14b46d74900d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.378013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1018/2032] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:23 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:23.382115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9bbe9-6de2-4fbd-acc3-a6e73486b6dd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.394021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9bbe9-6de2-4fbd-acc3-a6e73486b6dd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.471403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dd248-3fe6-41fa-b046-74e98dc4b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.472100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd248-3fe6-41fa-b046-74e98dc4b827 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.472391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd248-3fe6-41fa-b046-74e98dc4b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.472680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd248-3fe6-41fa-b046-74e98dc4b827 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.473388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dd248-3fe6-41fa-b046-74e98dc4b827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.476474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dd248-3fe6-41fa-b046-74e98dc4b827 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.497728 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1015/2033] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:23 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:23.501667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4d1e0-1da5-46ee-9fbe-14b46d74900d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.512705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4d1e0-1da5-46ee-9fbe-14b46d74900d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.517451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47219eb8-0e95-46a7-94a1-48c28850a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.518166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219eb8-0e95-46a7-94a1-48c28850a379 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.518451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219eb8-0e95-46a7-94a1-48c28850a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.518738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219eb8-0e95-46a7-94a1-48c28850a379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.519475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47219eb8-0e95-46a7-94a1-48c28850a379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.521803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47219eb8-0e95-46a7-94a1-48c28850a379 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.532951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1019/2034] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:23.538491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dd248-3fe6-41fa-b046-74e98dc4b827 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.549005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dd248-3fe6-41fa-b046-74e98dc4b827 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.554311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f37df-11db-429e-b888-19417a54c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.554988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f37df-11db-429e-b888-19417a54c21a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.555278 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f37df-11db-429e-b888-19417a54c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.555563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f37df-11db-429e-b888-19417a54c21a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.556293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f37df-11db-429e-b888-19417a54c21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.557950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f37df-11db-429e-b888-19417a54c21a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.571479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1016/2035] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:23.572954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47219eb8-0e95-46a7-94a1-48c28850a379 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.583971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47219eb8-0e95-46a7-94a1-48c28850a379 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.589125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536de126-8907-4ecd-9e86-e65d552b71a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.590073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536de126-8907-4ecd-9e86-e65d552b71a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.590364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536de126-8907-4ecd-9e86-e65d552b71a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.590655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536de126-8907-4ecd-9e86-e65d552b71a1 admin admin] PATH_INFO: `/v3/projects/4e17bf92bf2c4ceeaeb5e0599bb9f100/users/10aa40273b92455d93545adce7dd36b5/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.607396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536de126-8907-4ecd-9e86-e65d552b71a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e17bf92bf2c4ceeaeb5e0599bb9f100, user_id=10aa40273b92455d93545adce7dd36b5, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.610097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536de126-8907-4ecd-9e86-e65d552b71a1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.628062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1020/2036] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:23 2022] PUT /identity/v3/projects/4e17bf92bf2c4ceeaeb5e0599bb9f100/users/10aa40273b92455d93545adce7dd36b5/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:23.639074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71dfd-ee91-4328-9294-1315c1066161 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.639377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71dfd-ee91-4328-9294-1315c1066161 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.639668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71dfd-ee91-4328-9294-1315c1066161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.669140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d3d71dfd-ee91-4328-9294-1315c1066161 None None] MFA Rules not processed for user `10aa40273b92455d93545adce7dd36b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:23.670410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d3d71dfd-ee91-4328-9294-1315c1066161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:23.749067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1017/2037] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:23.753698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536de126-8907-4ecd-9e86-e65d552b71a1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.791949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:23.812056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d71dfd-ee91-4328-9294-1315c1066161 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.813710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d3d71dfd-ee91-4328-9294-1315c1066161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:23.828946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536de126-8907-4ecd-9e86-e65d552b71a1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.834744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e68dc-676a-4c28-9812-a2c5272e2ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.835450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e68dc-676a-4c28-9812-a2c5272e2ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.835743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e68dc-676a-4c28-9812-a2c5272e2ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.836030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e68dc-676a-4c28-9812-a2c5272e2ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.837245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e68dc-676a-4c28-9812-a2c5272e2ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.839623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e68dc-676a-4c28-9812-a2c5272e2ebd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.846458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:23.870329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1021/2038] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:23 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:23.874249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e68dc-676a-4c28-9812-a2c5272e2ebd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:23.898685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d71dfd-ee91-4328-9294-1315c1066161 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.955428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e68dc-676a-4c28-9812-a2c5272e2ebd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:23.962047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55f78-3531-40cd-97bd-ead2d6e22324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.962789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55f78-3531-40cd-97bd-ead2d6e22324 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.963030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55f78-3531-40cd-97bd-ead2d6e22324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.963294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55f78-3531-40cd-97bd-ead2d6e22324 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.963989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f55f78-3531-40cd-97bd-ead2d6e22324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.965960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f55f78-3531-40cd-97bd-ead2d6e22324 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:23.966877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:23.967779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:23.968076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:23.968502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] PATH_INFO: `/v3/users/3c0e73b6075848629d4d2ae5d0de1ea4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:23.969825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0e73b6075848629d4d2ae5d0de1ea4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:23.971859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:24.004165 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1022/2039] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:23 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:24.004954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55f78-3531-40cd-97bd-ead2d6e22324 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:24.016642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55f78-3531-40cd-97bd-ead2d6e22324 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:24.023338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125db7-7537-4126-aca8-9dba2c6f5e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:24.024071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125db7-7537-4126-aca8-9dba2c6f5e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.034257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125db7-7537-4126-aca8-9dba2c6f5e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.034257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125db7-7537-4126-aca8-9dba2c6f5e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.034257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125db7-7537-4126-aca8-9dba2c6f5e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:24.034257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125db7-7537-4126-aca8-9dba2c6f5e65 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:24.041039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1023/2040] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:24.042169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125db7-7537-4126-aca8-9dba2c6f5e65 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:24.053147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125db7-7537-4126-aca8-9dba2c6f5e65 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:24.054944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0e73b6075848629d4d2ae5d0de1ea4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.055656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0e73b6075848629d4d2ae5d0de1ea4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.059027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:24.060097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.060391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.060677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] PATH_INFO: `/v3/projects/65cbeb8599044db9a5e9cdaa2fb40af9/users/70398e9a56ee49dab7899e3881625352/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.065231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0e73b6075848629d4d2ae5d0de1ea4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.080095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cbeb8599044db9a5e9cdaa2fb40af9, user_id=70398e9a56ee49dab7899e3881625352, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:24.080325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0e73b6075848629d4d2ae5d0de1ea4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.082821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:24.089565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5986ab5c-4cd8-495d-907e-09d1c1688914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0e73b6075848629d4d2ae5d0de1ea4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.097865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1018/2042] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:23 2022] DELETE /identity/v3/users/3c0e73b6075848629d4d2ae5d0de1ea4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:24.098031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1024/2042] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:24 2022] PUT /identity/v3/projects/65cbeb8599044db9a5e9cdaa2fb40af9/users/70398e9a56ee49dab7899e3881625352/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:24.103362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191ec14-fb06-4a12-9c10-e15341dbac6d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.104518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191ec14-fb06-4a12-9c10-e15341dbac6d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.105079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191ec14-fb06-4a12-9c10-e15341dbac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.106868 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:24.109582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:24.138803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f191ec14-fb06-4a12-9c10-e15341dbac6d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:24.141639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f191ec14-fb06-4a12-9c10-e15341dbac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:24.206924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfc35c-453a-4948-8da9-7cb831c60a9f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:24.221681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:24.228989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:24.258936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1019/2043] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:01:24.268844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191ec14-fb06-4a12-9c10-e15341dbac6d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:24.270281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f191ec14-fb06-4a12-9c10-e15341dbac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:24.280244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad425e-27fa-4d46-9005-47546607af30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:24.280992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad425e-27fa-4d46-9005-47546607af30 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.281282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad425e-27fa-4d46-9005-47546607af30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.281588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad425e-27fa-4d46-9005-47546607af30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.282505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad425e-27fa-4d46-9005-47546607af30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:24.284128 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad425e-27fa-4d46-9005-47546607af30 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:24.295072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1025/2044] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:01:24.299190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad425e-27fa-4d46-9005-47546607af30 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:24.310003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad425e-27fa-4d46-9005-47546607af30 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:24.314723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50959a-689f-4dfc-9ad1-29da50f932ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:24.315629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50959a-689f-4dfc-9ad1-29da50f932ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.315912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50959a-689f-4dfc-9ad1-29da50f932ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.316199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50959a-689f-4dfc-9ad1-29da50f932ce admin admin] PATH_INFO: `/v3/projects/65cbeb8599044db9a5e9cdaa2fb40af9/users/70398e9a56ee49dab7899e3881625352/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.318984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50959a-689f-4dfc-9ad1-29da50f932ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cbeb8599044db9a5e9cdaa2fb40af9, user_id=70398e9a56ee49dab7899e3881625352, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:24.321030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50959a-689f-4dfc-9ad1-29da50f932ce admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:24.332207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1026/2045] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:24 2022] PUT /identity/v3/projects/65cbeb8599044db9a5e9cdaa2fb40af9/users/70398e9a56ee49dab7899e3881625352/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:24.333067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191ec14-fb06-4a12-9c10-e15341dbac6d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:24.343400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88487-64b4-4ec6-973a-0b02fe9af23d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.343700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88487-64b4-4ec6-973a-0b02fe9af23d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.344019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88487-64b4-4ec6-973a-0b02fe9af23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.372871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b3a88487-64b4-4ec6-973a-0b02fe9af23d None None] MFA Rules not processed for user `70398e9a56ee49dab7899e3881625352`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:24.374134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b3a88487-64b4-4ec6-973a-0b02fe9af23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:24.385417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:24.386017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.386310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.386590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.452820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:24.454317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:24.454870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1027/2046] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:01:24.464702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1020/2047] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:01:24.466764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a88487-64b4-4ec6-973a-0b02fe9af23d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:24.468158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b3a88487-64b4-4ec6-973a-0b02fe9af23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:24.532199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a88487-64b4-4ec6-973a-0b02fe9af23d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:24.537154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:24.537870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.538160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.538445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.540544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:24.585320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:24.607125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:24.608568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:24.624922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1028/2048] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:24.750463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:24.752564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:24.773588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de56e1-a424-438d-a4d2-abf873efcc5e service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:24.779087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:24.780238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.780608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.781030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] PATH_INFO: `/v3/projects/737818e2aaf449b4b5ded55f967bf253` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.782562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737818e2aaf449b4b5ded55f967bf253)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:24.785150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:24.841658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737818e2aaf449b4b5ded55f967bf253', 'request_id': 'req-711c90cf-d426-4315-8de3-9d2e4783d9f2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.844521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:24.851072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737818e2aaf449b4b5ded55f967bf253', 'request_id': 'req-711c90cf-d426-4315-8de3-9d2e4783d9f2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.858263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737818e2aaf449b4b5ded55f967bf253', 'request_id': 'req-711c90cf-d426-4315-8de3-9d2e4783d9f2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.871119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] The token cache is being invalidate because project 737818e2aaf449b4b5ded55f967bf253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:24.871510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.872185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:24.876673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1021/2049] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:24 2022] DELETE /identity/v3/projects/737818e2aaf449b4b5ded55f967bf253 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:24.878848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:24.892089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed32cb-81d5-4d4e-a0bf-7fa49385af22 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:24.957375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:24.958597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:24.959056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:24.959342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] PATH_INFO: `/v3/users/4b899cc067854420aa7005e591bef747` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:24.961442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b899cc067854420aa7005e591bef747)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:24.963591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:25.016371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b899cc067854420aa7005e591bef747'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.017063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b899cc067854420aa7005e591bef747'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.024808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b899cc067854420aa7005e591bef747'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.033726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b899cc067854420aa7005e591bef747'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.034476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fcb62df8-a181-4cd0-9af9-082b5efd24bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b899cc067854420aa7005e591bef747'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.055084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1029/2050] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:24 2022] DELETE /identity/v3/users/4b899cc067854420aa7005e591bef747 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:25.346364 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:25.347906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:25.360963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c90cf-d426-4315-8de3-9d2e4783d9f2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:25.422392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:25.423276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.423568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.423858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] PATH_INFO: `/v3/projects/450cb782744b40078859228d6a49e7db` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.425053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=450cb782744b40078859228d6a49e7db)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:25.427120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:25.474109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450cb782744b40078859228d6a49e7db', 'request_id': 'req-55366a97-1f89-4f4c-942b-3a9a1754ff05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.481602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450cb782744b40078859228d6a49e7db', 'request_id': 'req-55366a97-1f89-4f4c-942b-3a9a1754ff05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.487094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450cb782744b40078859228d6a49e7db', 'request_id': 'req-55366a97-1f89-4f4c-942b-3a9a1754ff05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.498750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] The token cache is being invalidate because project 450cb782744b40078859228d6a49e7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:25.499041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.499674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55366a97-1f89-4f4c-942b-3a9a1754ff05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:25.501206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1022/2051] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:25 2022] DELETE /identity/v3/projects/450cb782744b40078859228d6a49e7db => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:25.506909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ace1f-7a2b-49bc-bd91-75d3871c9a89 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.507254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ace1f-7a2b-49bc-bd91-75d3871c9a89 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.507462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ace1f-7a2b-49bc-bd91-75d3871c9a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.525664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e65ace1f-7a2b-49bc-bd91-75d3871c9a89 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:25.526893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e65ace1f-7a2b-49bc-bd91-75d3871c9a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:25.589812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:25.601323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1030/2052] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:25.609083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870af24-6578-462c-8276-fbfe7dd67f6c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.609381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870af24-6578-462c-8276-fbfe7dd67f6c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.609706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870af24-6578-462c-8276-fbfe7dd67f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.629219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a870af24-6578-462c-8276-fbfe7dd67f6c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:25.631454 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a870af24-6578-462c-8276-fbfe7dd67f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:25.639848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1023/2053] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:25.644175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ace1f-7a2b-49bc-bd91-75d3871c9a89 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:25.654026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ace1f-7a2b-49bc-bd91-75d3871c9a89 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:25.658660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:25.659353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.659646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.659932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.660669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:01:25.660984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:25.662678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:25.674309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1031/2054] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:01:25.679094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870af24-6578-462c-8276-fbfe7dd67f6c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:25.688366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870af24-6578-462c-8276-fbfe7dd67f6c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:25.693651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09715c3c-5d5f-4232-90a1-9da51539211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:25.694357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09715c3c-5d5f-4232-90a1-9da51539211b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.694641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09715c3c-5d5f-4232-90a1-9da51539211b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.695209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09715c3c-5d5f-4232-90a1-9da51539211b admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.695921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09715c3c-5d5f-4232-90a1-9da51539211b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:25.697874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09715c3c-5d5f-4232-90a1-9da51539211b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:25.724252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1024/2055] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:25 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:01:25.728452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:25.739541 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f197b5-6d73-46b2-97c7-3e002c76eb21 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:25.799397 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0897e-e368-4bac-8755-f02fdf45ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:25.800077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0897e-e368-4bac-8755-f02fdf45ae16 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.800363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0897e-e368-4bac-8755-f02fdf45ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.800644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0897e-e368-4bac-8755-f02fdf45ae16 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.801341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0897e-e368-4bac-8755-f02fdf45ae16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:25.803928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0897e-e368-4bac-8755-f02fdf45ae16 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:25.827729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1032/2056] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:25 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:25.831964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09715c3c-5d5f-4232-90a1-9da51539211b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:25.842966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09715c3c-5d5f-4232-90a1-9da51539211b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:25.847975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d2132-4093-4324-93ab-df01e67518e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:25.848647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d2132-4093-4324-93ab-df01e67518e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.848989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d2132-4093-4324-93ab-df01e67518e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.849321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d2132-4093-4324-93ab-df01e67518e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.850128 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d2132-4093-4324-93ab-df01e67518e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:25.851748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d2132-4093-4324-93ab-df01e67518e5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:25.862758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1025/2057] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:01:25.867737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0897e-e368-4bac-8755-f02fdf45ae16 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:25.878261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0897e-e368-4bac-8755-f02fdf45ae16 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:25.883872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ecac6-4ee9-4820-8f30-f57e4581681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:25.884540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ecac6-4ee9-4820-8f30-f57e4581681c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.884955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ecac6-4ee9-4820-8f30-f57e4581681c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.885242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ecac6-4ee9-4820-8f30-f57e4581681c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.886016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ecac6-4ee9-4820-8f30-f57e4581681c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:25.887632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ecac6-4ee9-4820-8f30-f57e4581681c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:25.898783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1033/2058] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:25.903049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d2132-4093-4324-93ab-df01e67518e5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:25.913403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d2132-4093-4324-93ab-df01e67518e5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:25.918372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f91dba-4ce6-44e5-9a45-8d3b2ce25821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:25.919299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f91dba-4ce6-44e5-9a45-8d3b2ce25821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.919588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f91dba-4ce6-44e5-9a45-8d3b2ce25821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.919873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f91dba-4ce6-44e5-9a45-8d3b2ce25821 admin admin] PATH_INFO: `/v3/projects/395011485b5a4c6bafbb66f5879555fe/users/e80ee165d0a84d49971b3d8ad5f5c592/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.936533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f91dba-4ce6-44e5-9a45-8d3b2ce25821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395011485b5a4c6bafbb66f5879555fe, user_id=e80ee165d0a84d49971b3d8ad5f5c592, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:25.939166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f91dba-4ce6-44e5-9a45-8d3b2ce25821 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:25.957437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1026/2059] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:25 2022] PUT /identity/v3/projects/395011485b5a4c6bafbb66f5879555fe/users/e80ee165d0a84d49971b3d8ad5f5c592/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:25.969465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611031-8e2d-41e6-b745-dc240f1dfb5e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:25.969665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611031-8e2d-41e6-b745-dc240f1dfb5e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:25.969911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611031-8e2d-41e6-b745-dc240f1dfb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:25.998791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d3611031-8e2d-41e6-b745-dc240f1dfb5e None None] MFA Rules not processed for user `e80ee165d0a84d49971b3d8ad5f5c592`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:25.999999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d3611031-8e2d-41e6-b745-dc240f1dfb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:26.066848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1034/2060] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:26.071696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f91dba-4ce6-44e5-9a45-8d3b2ce25821 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:26.077600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:26.143106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f91dba-4ce6-44e5-9a45-8d3b2ce25821 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:26.148253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cf5c4-d689-4a36-8053-9a1ff67d4847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:26.148922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cf5c4-d689-4a36-8053-9a1ff67d4847 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:26.149212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cf5c4-d689-4a36-8053-9a1ff67d4847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:26.149488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cf5c4-d689-4a36-8053-9a1ff67d4847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:26.150230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cf5c4-d689-4a36-8053-9a1ff67d4847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:26.152152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cf5c4-d689-4a36-8053-9a1ff67d4847 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:26.184991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1027/2061] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:26 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:26.189202 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3611031-8e2d-41e6-b745-dc240f1dfb5e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:26.200642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3611031-8e2d-41e6-b745-dc240f1dfb5e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:26.257006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:26.274168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c774f2-a2be-4410-be05-6b9e8bed4d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:26.274907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c774f2-a2be-4410-be05-6b9e8bed4d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:26.275201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c774f2-a2be-4410-be05-6b9e8bed4d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:26.275482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c774f2-a2be-4410-be05-6b9e8bed4d98 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:26.276205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c774f2-a2be-4410-be05-6b9e8bed4d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:26.278179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c774f2-a2be-4410-be05-6b9e8bed4d98 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:26.305600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1035/2062] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:26 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:26.309299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cf5c4-d689-4a36-8053-9a1ff67d4847 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:26.322772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cf5c4-d689-4a36-8053-9a1ff67d4847 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:26.328303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893ff14-2e18-4f1a-b93b-28b060e7b52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:26.329006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ff14-2e18-4f1a-b93b-28b060e7b52e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:26.329298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ff14-2e18-4f1a-b93b-28b060e7b52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:26.329610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ff14-2e18-4f1a-b93b-28b060e7b52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:26.330375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893ff14-2e18-4f1a-b93b-28b060e7b52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:26.332039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893ff14-2e18-4f1a-b93b-28b060e7b52e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:26.344671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1028/2063] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:26.349900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c774f2-a2be-4410-be05-6b9e8bed4d98 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:26.360982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c774f2-a2be-4410-be05-6b9e8bed4d98 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:26.366642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c99776-6a2d-4e59-9dce-e0c4e557c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:26.367572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99776-6a2d-4e59-9dce-e0c4e557c728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:26.367872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99776-6a2d-4e59-9dce-e0c4e557c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:26.368144 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99776-6a2d-4e59-9dce-e0c4e557c728 admin admin] PATH_INFO: `/v3/projects/247327279f774c828f9ab7d11c64beed/users/01b87f2795644497af676f9ad192e13b/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:26.387016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c99776-6a2d-4e59-9dce-e0c4e557c728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247327279f774c828f9ab7d11c64beed, user_id=01b87f2795644497af676f9ad192e13b, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:26.390052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c99776-6a2d-4e59-9dce-e0c4e557c728 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:26.410813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1036/2064] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:26 2022] PUT /identity/v3/projects/247327279f774c828f9ab7d11c64beed/users/01b87f2795644497af676f9ad192e13b/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:26.415696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893ff14-2e18-4f1a-b93b-28b060e7b52e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:26.427307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893ff14-2e18-4f1a-b93b-28b060e7b52e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:26.496133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09ca98-80af-4684-baf4-70be69ef5bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:26.497527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09ca98-80af-4684-baf4-70be69ef5bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:26.497856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09ca98-80af-4684-baf4-70be69ef5bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:26.498141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09ca98-80af-4684-baf4-70be69ef5bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:26.498884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09ca98-80af-4684-baf4-70be69ef5bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:26.500504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09ca98-80af-4684-baf4-70be69ef5bbc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:26.513383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1029/2065] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:26.517903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c99776-6a2d-4e59-9dce-e0c4e557c728 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:26.531316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c99776-6a2d-4e59-9dce-e0c4e557c728 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:26.537985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:26.539208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:26.539496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:26.539780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] PATH_INFO: `/v3/projects/247327279f774c828f9ab7d11c64beed/users/01b87f2795644497af676f9ad192e13b/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:26.541871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=247327279f774c828f9ab7d11c64beed, user_id=01b87f2795644497af676f9ad192e13b, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:26.544537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:26.555590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1037/2066] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:26 2022] PUT /identity/v3/projects/247327279f774c828f9ab7d11c64beed/users/01b87f2795644497af676f9ad192e13b/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:26.571476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5720-fe4c-4cba-9878-9037ecd08f3d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:26.573098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5720-fe4c-4cba-9878-9037ecd08f3d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:26.573445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5720-fe4c-4cba-9878-9037ecd08f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:26.603509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7aeb5720-fe4c-4cba-9878-9037ecd08f3d None None] MFA Rules not processed for user `01b87f2795644497af676f9ad192e13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:26.606319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7aeb5720-fe4c-4cba-9878-9037ecd08f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:26.690908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:26.698074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1030/2067] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:26.710502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:26.713032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:26.789536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e752f-07cf-4d0d-80b6-0d52ec9ecffc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:26.795017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694c1c-0137-420c-a0d9-47ec288f4e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:26.796089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694c1c-0137-420c-a0d9-47ec288f4e11 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:26.796558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694c1c-0137-420c-a0d9-47ec288f4e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:26.797017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694c1c-0137-420c-a0d9-47ec288f4e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:26.874900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3694c1c-0137-420c-a0d9-47ec288f4e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:26.876376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3694c1c-0137-420c-a0d9-47ec288f4e11 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:26.895327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1038/2068] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:01:30.429107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb5720-fe4c-4cba-9878-9037ecd08f3d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:30.430700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7aeb5720-fe4c-4cba-9878-9037ecd08f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:30.449191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb5720-fe4c-4cba-9878-9037ecd08f3d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:30.449300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:30.450524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:30.450987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:30.451765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:30.454266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:30.540001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:30.542796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:30.562990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1031/2069] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:01:31.183894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694c1c-0137-420c-a0d9-47ec288f4e11 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:31.193059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694c1c-0137-420c-a0d9-47ec288f4e11 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:31.196853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:31.197509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:31.197828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:31.198112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:31.199884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:31.266230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:31.271325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:31.273733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:31.287841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1039/2070] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:35.862867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:35.872680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10727362-9527-42b3-8767-8759cf148963 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:35.876640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535a43-3efc-481b-8a75-ef4e70d43dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:35.877300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535a43-3efc-481b-8a75-ef4e70d43dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:35.877664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535a43-3efc-481b-8a75-ef4e70d43dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:35.877894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535a43-3efc-481b-8a75-ef4e70d43dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:35.888379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6535a43-3efc-481b-8a75-ef4e70d43dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:35.889924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6535a43-3efc-481b-8a75-ef4e70d43dc9 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:35.901057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1032/2071] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:36.051042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:36.052505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:36.127569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bedbe7-b273-4c73-91a7-661ab68bc461 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:36.133299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:36.134441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:36.134790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:36.135139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] PATH_INFO: `/v3/users/663ebe705a1c46e5a441cd7210d31022` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:36.136585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=663ebe705a1c46e5a441cd7210d31022)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:36.139979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:36.201733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663ebe705a1c46e5a441cd7210d31022'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.202667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663ebe705a1c46e5a441cd7210d31022'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.214216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663ebe705a1c46e5a441cd7210d31022'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.227805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663ebe705a1c46e5a441cd7210d31022'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.227805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663ebe705a1c46e5a441cd7210d31022'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.246679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1040/2072] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:36 2022] DELETE /identity/v3/users/663ebe705a1c46e5a441cd7210d31022 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:36.252210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ed245-e437-4f15-a588-b709c6fc4d7e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:36.252493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ed245-e437-4f15-a588-b709c6fc4d7e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:36.252771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ed245-e437-4f15-a588-b709c6fc4d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:36.277709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0e2ed245-e437-4f15-a588-b709c6fc4d7e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:36.279513 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0e2ed245-e437-4f15-a588-b709c6fc4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:36.355341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1033/2073] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:36.365469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:36.367739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:36.453009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246ce2d-f834-4121-9983-300e23e6bcb3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:36.456893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:36.457616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:36.457947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:36.458257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:36.474456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:36.477136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:36.490821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1041/2074] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:36.811146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ed245-e437-4f15-a588-b709c6fc4d7e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:36.812685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0e2ed245-e437-4f15-a588-b709c6fc4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:36.826444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ed245-e437-4f15-a588-b709c6fc4d7e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:36.831974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:36.834392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:36.834629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:36.834888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] PATH_INFO: `/v3/projects/1bff61a2fe6545e9b39f0fc18dcdca50` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:36.836546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bff61a2fe6545e9b39f0fc18dcdca50)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:36.838764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:36.902689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bff61a2fe6545e9b39f0fc18dcdca50', 'request_id': 'req-5fb45199-258f-44e7-a29b-4b54a39f8ad1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.912700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bff61a2fe6545e9b39f0fc18dcdca50', 'request_id': 'req-5fb45199-258f-44e7-a29b-4b54a39f8ad1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.920414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bff61a2fe6545e9b39f0fc18dcdca50', 'request_id': 'req-5fb45199-258f-44e7-a29b-4b54a39f8ad1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.938219 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] The token cache is being invalidate because project 1bff61a2fe6545e9b39f0fc18dcdca50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:36.938682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.939684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5fb45199-258f-44e7-a29b-4b54a39f8ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:36.942826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1034/2075] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:36 2022] DELETE /identity/v3/projects/1bff61a2fe6545e9b39f0fc18dcdca50 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:41.566770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:41.568624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:41.584073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c5cf0-a60a-40d5-b076-638c8246516a service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:41.597530 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:41.656191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:41.656991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:41.657283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:41.657595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] PATH_INFO: `/v3/users/e0ba2752520e4745840e0edff7d7ad30` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:41.658818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ba2752520e4745840e0edff7d7ad30)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:41.661345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:41.713723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ba2752520e4745840e0edff7d7ad30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:41.714393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ba2752520e4745840e0edff7d7ad30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:41.727098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ba2752520e4745840e0edff7d7ad30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:41.741206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ba2752520e4745840e0edff7d7ad30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:41.741934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ba2752520e4745840e0edff7d7ad30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:41.762832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1042/2076] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:41 2022] DELETE /identity/v3/users/e0ba2752520e4745840e0edff7d7ad30 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:41.767563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0558cc-fade-4444-a0d2-4e6b9cb5409e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:41.768055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0558cc-fade-4444-a0d2-4e6b9cb5409e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:41.768183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0558cc-fade-4444-a0d2-4e6b9cb5409e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:41.791528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2e0558cc-fade-4444-a0d2-4e6b9cb5409e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:41.792776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2e0558cc-fade-4444-a0d2-4e6b9cb5409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:41.797296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:41.867345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1035/2077] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:41.877908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:41.879362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:41.947592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21365d-fee5-4943-ba5b-82f219a74bd5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:41.951287 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199b5e-19bc-4079-a762-94d5946e5c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:41.951961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199b5e-19bc-4079-a762-94d5946e5c24 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:41.952251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199b5e-19bc-4079-a762-94d5946e5c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:41.952537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199b5e-19bc-4079-a762-94d5946e5c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:41.964882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199b5e-19bc-4079-a762-94d5946e5c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:41.966407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199b5e-19bc-4079-a762-94d5946e5c24 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:41.977642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1043/2078] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:01:42.271972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0558cc-fade-4444-a0d2-4e6b9cb5409e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:42.273981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2e0558cc-fade-4444-a0d2-4e6b9cb5409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:42.288298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0558cc-fade-4444-a0d2-4e6b9cb5409e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:42.293715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:42.296060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:42.296451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:42.297012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] PATH_INFO: `/v3/projects/6824f1af8fca44fab8ed5c97220360ee` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:42.298973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6824f1af8fca44fab8ed5c97220360ee)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:42.302149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:42.356186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6824f1af8fca44fab8ed5c97220360ee', 'request_id': 'req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.371136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6824f1af8fca44fab8ed5c97220360ee', 'request_id': 'req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.379097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6824f1af8fca44fab8ed5c97220360ee', 'request_id': 'req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.393119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] The token cache is being invalidate because project 6824f1af8fca44fab8ed5c97220360ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:42.393465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.394234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.396778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1036/2079] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:42 2022] DELETE /identity/v3/projects/6824f1af8fca44fab8ed5c97220360ee => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:42.401262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199b5e-19bc-4079-a762-94d5946e5c24 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:42.416107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199b5e-19bc-4079-a762-94d5946e5c24 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:42.459772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:42.491804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:42.492720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:42.493021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:42.493616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] PATH_INFO: `/v3/users/10aa40273b92455d93545adce7dd36b5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:42.494872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10aa40273b92455d93545adce7dd36b5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:42.496803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:42.550640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10aa40273b92455d93545adce7dd36b5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.551511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10aa40273b92455d93545adce7dd36b5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.559770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10aa40273b92455d93545adce7dd36b5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.572722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10aa40273b92455d93545adce7dd36b5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.573473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10aa40273b92455d93545adce7dd36b5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:42.601011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1044/2080] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:42 2022] DELETE /identity/v3/users/10aa40273b92455d93545adce7dd36b5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:42.944156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:42.945821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:42.961770 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7bcd-7a4a-4436-b7a4-aa97f2e6f3b5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:43.025976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:43.026934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:43.027277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:43.027614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] PATH_INFO: `/v3/projects/4e17bf92bf2c4ceeaeb5e0599bb9f100` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:43.028931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e17bf92bf2c4ceeaeb5e0599bb9f100)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:43.030970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:43.073240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:43.086874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e17bf92bf2c4ceeaeb5e0599bb9f100', 'request_id': 'req-4f7164e5-2195-4983-ac08-8f628110ecc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.095186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e17bf92bf2c4ceeaeb5e0599bb9f100', 'request_id': 'req-4f7164e5-2195-4983-ac08-8f628110ecc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.103066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e17bf92bf2c4ceeaeb5e0599bb9f100', 'request_id': 'req-4f7164e5-2195-4983-ac08-8f628110ecc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.115117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] The token cache is being invalidate because project 4e17bf92bf2c4ceeaeb5e0599bb9f100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:43.115440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.122772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.124674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1037/2081] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:42 2022] DELETE /identity/v3/projects/4e17bf92bf2c4ceeaeb5e0599bb9f100 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:43.129245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:43.131011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:43.144801 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fbf6d-ac09-4b0d-b6d6-69f9d7a5678e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:43.225631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:43.226502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:43.226795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:43.227087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] PATH_INFO: `/v3/users/70398e9a56ee49dab7899e3881625352` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:43.228316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=70398e9a56ee49dab7899e3881625352)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:43.230321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:43.282653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70398e9a56ee49dab7899e3881625352'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.283415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70398e9a56ee49dab7899e3881625352'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.296008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70398e9a56ee49dab7899e3881625352'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.298988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:43.305047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70398e9a56ee49dab7899e3881625352'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.305893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4df63f97-1908-49f8-bd74-dd22e11592bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70398e9a56ee49dab7899e3881625352'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.326657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1045/2082] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:01:43 2022] DELETE /identity/v3/users/70398e9a56ee49dab7899e3881625352 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:43.730491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:43.732870 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:43.755198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7164e5-2195-4983-ac08-8f628110ecc0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:43.830193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:43.831072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:43.831357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:43.831638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] PATH_INFO: `/v3/projects/65cbeb8599044db9a5e9cdaa2fb40af9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:43.832889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cbeb8599044db9a5e9cdaa2fb40af9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:43.834843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:43.889514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cbeb8599044db9a5e9cdaa2fb40af9', 'request_id': 'req-899e3077-24cf-4fe3-b139-68fbb077131f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.898265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cbeb8599044db9a5e9cdaa2fb40af9', 'request_id': 'req-899e3077-24cf-4fe3-b139-68fbb077131f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.906431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cbeb8599044db9a5e9cdaa2fb40af9', 'request_id': 'req-899e3077-24cf-4fe3-b139-68fbb077131f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.924518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] The token cache is being invalidate because project 65cbeb8599044db9a5e9cdaa2fb40af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:01:43.924875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.925601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-899e3077-24cf-4fe3-b139-68fbb077131f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:01:43.928054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1038/2083] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:01:43 2022] DELETE /identity/v3/projects/65cbeb8599044db9a5e9cdaa2fb40af9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:01:43.932989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039783a-e507-46cd-92a8-8e10fdd1b09c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:43.933510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039783a-e507-46cd-92a8-8e10fdd1b09c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:43.933637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039783a-e507-46cd-92a8-8e10fdd1b09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:43.952850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c039783a-e507-46cd-92a8-8e10fdd1b09c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:43.954176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c039783a-e507-46cd-92a8-8e10fdd1b09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:44.033422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1046/2084] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:44.043092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca6d66-b3c3-4f0b-a6aa-efcaa3156deb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.043632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca6d66-b3c3-4f0b-a6aa-efcaa3156deb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.043733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca6d66-b3c3-4f0b-a6aa-efcaa3156deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.106431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a8ca6d66-b3c3-4f0b-a6aa-efcaa3156deb None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:44.107673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a8ca6d66-b3c3-4f0b-a6aa-efcaa3156deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:44.116778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1039/2085] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:44.121537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039783a-e507-46cd-92a8-8e10fdd1b09c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:44.131744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039783a-e507-46cd-92a8-8e10fdd1b09c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:44.144806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:44.145743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.146042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.146329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.147075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:01:44.147390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:44.149016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:44.169627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1047/2086] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:01:44.169860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca6d66-b3c3-4f0b-a6aa-efcaa3156deb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:44.182066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:44.204550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca6d66-b3c3-4f0b-a6aa-efcaa3156deb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:44.209428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbec27-b4cb-428d-8003-f824938a0ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:44.210136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbec27-b4cb-428d-8003-f824938a0ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.210431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbec27-b4cb-428d-8003-f824938a0ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.210721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbec27-b4cb-428d-8003-f824938a0ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.211434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbec27-b4cb-428d-8003-f824938a0ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:44.213373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbec27-b4cb-428d-8003-f824938a0ac6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:44.242451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1040/2087] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:01:44 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:44.246652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:44.275683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa847238-48b9-40f8-a962-1642c8d6cf84 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:44.337385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269ce6-001f-470a-adcf-06ef4a5a34a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:44.338104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269ce6-001f-470a-adcf-06ef4a5a34a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.338394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269ce6-001f-470a-adcf-06ef4a5a34a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.338677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269ce6-001f-470a-adcf-06ef4a5a34a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.339416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f269ce6-001f-470a-adcf-06ef4a5a34a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:44.341343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f269ce6-001f-470a-adcf-06ef4a5a34a7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:44.363234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1048/2088] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:01:44 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:01:44.368427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbec27-b4cb-428d-8003-f824938a0ac6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:44.379232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbec27-b4cb-428d-8003-f824938a0ac6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:44.384750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7c8ce-8514-45e9-b7f5-3ddb6e954347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:44.385429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c8ce-8514-45e9-b7f5-3ddb6e954347 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.385778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c8ce-8514-45e9-b7f5-3ddb6e954347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.386063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c8ce-8514-45e9-b7f5-3ddb6e954347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.386812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7c8ce-8514-45e9-b7f5-3ddb6e954347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:44.388545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7c8ce-8514-45e9-b7f5-3ddb6e954347 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:44.399485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1041/2089] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:44.403496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269ce6-001f-470a-adcf-06ef4a5a34a7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:44.418228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269ce6-001f-470a-adcf-06ef4a5a34a7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:44.419284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0f75-741c-4407-ab17-c78a778ad35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:44.419965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0f75-741c-4407-ab17-c78a778ad35a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.420255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0f75-741c-4407-ab17-c78a778ad35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.420551 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0f75-741c-4407-ab17-c78a778ad35a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.421288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c0f75-741c-4407-ab17-c78a778ad35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:44.423031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c0f75-741c-4407-ab17-c78a778ad35a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:44.435073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1049/2090] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:01:44.439255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7c8ce-8514-45e9-b7f5-3ddb6e954347 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:44.449841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7c8ce-8514-45e9-b7f5-3ddb6e954347 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:44.455011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:44.455903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.456188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.456464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] PATH_INFO: `/v3/projects/c0be836228cf4684abf00789cddeb8a3/users/e6a0a886879746eab48090496801c641/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.474883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0be836228cf4684abf00789cddeb8a3, user_id=e6a0a886879746eab48090496801c641, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:44.477583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:44.491545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1042/2091] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:01:44 2022] PUT /identity/v3/projects/c0be836228cf4684abf00789cddeb8a3/users/e6a0a886879746eab48090496801c641/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:01:44.561812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f397-cbee-48b8-8a06-8999fc4d709f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.562117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f397-cbee-48b8-8a06-8999fc4d709f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.562410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320f397-cbee-48b8-8a06-8999fc4d709f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.591317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2320f397-cbee-48b8-8a06-8999fc4d709f None None] MFA Rules not processed for user `e6a0a886879746eab48090496801c641`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:01:44.592462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2320f397-cbee-48b8-8a06-8999fc4d709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:44.598125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:44.667119 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1050/2092] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:01:44.678572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:01:44.680320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:01:44.761497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e65f62-7f7b-4a2d-80a3-3180c23b0b73 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:01:44.765403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd38e1-563c-4a54-b2ca-0d519f2c3a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:01:44.766334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd38e1-563c-4a54-b2ca-0d519f2c3a96 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:01:44.768372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd38e1-563c-4a54-b2ca-0d519f2c3a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:01:44.768372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd38e1-563c-4a54-b2ca-0d519f2c3a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:01:44.777970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd38e1-563c-4a54-b2ca-0d519f2c3a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:01:44.779453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd38e1-563c-4a54-b2ca-0d519f2c3a96 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:01:44.792936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1043/2093] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:01:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:01:54.663783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=24 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:01:54.785312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=62,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:12.401105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320f397-cbee-48b8-8a06-8999fc4d709f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:12.402661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2320f397-cbee-48b8-8a06-8999fc4d709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:12.578694 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320f397-cbee-48b8-8a06-8999fc4d709f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:12.598558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:12.598558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:12.598558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:12.598558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] PATH_INFO: `/v3/users/e80ee165d0a84d49971b3d8ad5f5c592` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:12.598887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80ee165d0a84d49971b3d8ad5f5c592)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:12.600370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:12.686114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80ee165d0a84d49971b3d8ad5f5c592'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:12.687004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80ee165d0a84d49971b3d8ad5f5c592'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:12.697967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80ee165d0a84d49971b3d8ad5f5c592'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:12.708059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80ee165d0a84d49971b3d8ad5f5c592'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:12.708705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80ee165d0a84d49971b3d8ad5f5c592'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:12.732679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1051/2094] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:12 2022] DELETE /identity/v3/users/e80ee165d0a84d49971b3d8ad5f5c592 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:12.737178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee716-ed4f-40b7-a5a6-254004c64c4f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:12.738278 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee716-ed4f-40b7-a5a6-254004c64c4f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:12.738356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee716-ed4f-40b7-a5a6-254004c64c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:12.764656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-855ee716-ed4f-40b7-a5a6-254004c64c4f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:12.765937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-855ee716-ed4f-40b7-a5a6-254004c64c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:12.844105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1044/2095] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:12.855070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:12.856536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:12.923940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fa01e-83c7-4ac6-ae55-f082dfc8c0c3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:12.924355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fa01e-83c7-4ac6-ae55-f082dfc8c0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:12.924773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fa01e-83c7-4ac6-ae55-f082dfc8c0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:12.944491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6e2fa01e-83c7-4ac6-ae55-f082dfc8c0c3 None None] MFA Rules not processed for user `2a550d483fee4f84a11dccf72fc85dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:12.945136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:12.947191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6e2fa01e-83c7-4ac6-ae55-f082dfc8c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:12.957945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea9ba6-c138-4428-b5b5-f2265fa5a082 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:12.962372 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:12.963048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:12.963342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:12.963638 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:12.974981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:12.976458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:12.987194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1052/2096] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:13.027775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1045/2097] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:02:13.316664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:13.319213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:13.336758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708ea05-f188-4c4d-94b3-73a95a956014 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:13.342268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:13.343709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:13.343993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:13.344270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] PATH_INFO: `/v3/projects/395011485b5a4c6bafbb66f5879555fe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:13.345508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] RBAC: Authorizing `identity:delete_project(project_id=395011485b5a4c6bafbb66f5879555fe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:13.347633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:13.410743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395011485b5a4c6bafbb66f5879555fe', 'request_id': 'req-242ef7be-f79d-4a9e-88a1-c9b44882973f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.416706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395011485b5a4c6bafbb66f5879555fe', 'request_id': 'req-242ef7be-f79d-4a9e-88a1-c9b44882973f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.431924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395011485b5a4c6bafbb66f5879555fe', 'request_id': 'req-242ef7be-f79d-4a9e-88a1-c9b44882973f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.456926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] The token cache is being invalidate because project 395011485b5a4c6bafbb66f5879555fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:13.457340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.458182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.460072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1053/2098] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:13 2022] DELETE /identity/v3/projects/395011485b5a4c6bafbb66f5879555fe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:13.464343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fa01e-83c7-4ac6-ae55-f082dfc8c0c3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:13.477172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fa01e-83c7-4ac6-ae55-f082dfc8c0c3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:13.545350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:13.546382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:13.546671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:13.546955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] PATH_INFO: `/v3/users/01b87f2795644497af676f9ad192e13b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:13.548254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b87f2795644497af676f9ad192e13b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:13.551138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:13.615493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b87f2795644497af676f9ad192e13b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.617512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b87f2795644497af676f9ad192e13b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.620135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:13.631897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b87f2795644497af676f9ad192e13b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.647212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b87f2795644497af676f9ad192e13b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.662985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e4becdb-24cc-4114-92c9-ee64d9b5fca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b87f2795644497af676f9ad192e13b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:13.670423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1046/2099] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:13 2022] DELETE /identity/v3/users/01b87f2795644497af676f9ad192e13b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:14.064699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:14.067063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:14.082660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef7be-f79d-4a9e-88a1-c9b44882973f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:14.169115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:14.170258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.170723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.171069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] PATH_INFO: `/v3/projects/247327279f774c828f9ab7d11c64beed` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.172558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247327279f774c828f9ab7d11c64beed)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:14.174572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:14.231253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247327279f774c828f9ab7d11c64beed', 'request_id': 'req-e6446c40-b1a8-4d7b-be62-192d22cd7134'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:14.239690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247327279f774c828f9ab7d11c64beed', 'request_id': 'req-e6446c40-b1a8-4d7b-be62-192d22cd7134'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:14.248168 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247327279f774c828f9ab7d11c64beed', 'request_id': 'req-e6446c40-b1a8-4d7b-be62-192d22cd7134'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:14.256988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:14.265295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] The token cache is being invalidate because project 247327279f774c828f9ab7d11c64beed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:14.266325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:14.267258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6446c40-b1a8-4d7b-be62-192d22cd7134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:14.269699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1054/2100] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:14 2022] DELETE /identity/v3/projects/247327279f774c828f9ab7d11c64beed => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:14.275514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315ea1-1d3a-4296-a88d-37957307c5de None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.276228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315ea1-1d3a-4296-a88d-37957307c5de None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.276228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315ea1-1d3a-4296-a88d-37957307c5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.323194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-81315ea1-1d3a-4296-a88d-37957307c5de None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:14.324441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-81315ea1-1d3a-4296-a88d-37957307c5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:14.404536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1047/2101] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:02:14.413447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5279-a4a2-4cfb-927a-25c43958b942 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.414019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5279-a4a2-4cfb-927a-25c43958b942 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.414019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5279-a4a2-4cfb-927a-25c43958b942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.435887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e81b5279-a4a2-4cfb-927a-25c43958b942 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:14.437149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e81b5279-a4a2-4cfb-927a-25c43958b942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:14.445704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1055/2102] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:14.450347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81315ea1-1d3a-4296-a88d-37957307c5de None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:14.463038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81315ea1-1d3a-4296-a88d-37957307c5de None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:14.471120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:14.471801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.476575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.476575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.476575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:02:14.476575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:14.476575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:14.497276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1048/2103] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:02:14.501446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b5279-a4a2-4cfb-927a-25c43958b942 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:14.512070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b5279-a4a2-4cfb-927a-25c43958b942 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:14.518252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b36aa5-b250-4d48-b5e8-4640a6d1b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:14.519515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b36aa5-b250-4d48-b5e8-4640a6d1b8ac admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.519515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b36aa5-b250-4d48-b5e8-4640a6d1b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.520268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b36aa5-b250-4d48-b5e8-4640a6d1b8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.521066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b36aa5-b250-4d48-b5e8-4640a6d1b8ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:14.523113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b36aa5-b250-4d48-b5e8-4640a6d1b8ac admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:14.552496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1056/2104] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:14 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:02:14.557674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:14.569536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998921c-041d-4b28-9be4-9b78b369075e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:14.636970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7cd9-81ae-4762-884b-729428305e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:14.637695 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7cd9-81ae-4762-884b-729428305e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.637984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7cd9-81ae-4762-884b-729428305e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.638263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7cd9-81ae-4762-884b-729428305e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.638957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd7cd9-81ae-4762-884b-729428305e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:14.640987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd7cd9-81ae-4762-884b-729428305e6b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:14.665198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1049/2105] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:02:14 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:14.669249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b36aa5-b250-4d48-b5e8-4640a6d1b8ac admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:14.680392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b36aa5-b250-4d48-b5e8-4640a6d1b8ac admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:14.685336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4044c-c51e-4fa6-83ab-93108a22a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:14.686062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4044c-c51e-4fa6-83ab-93108a22a2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.686356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4044c-c51e-4fa6-83ab-93108a22a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.686643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4044c-c51e-4fa6-83ab-93108a22a2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.687384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4044c-c51e-4fa6-83ab-93108a22a2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:14.689021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4044c-c51e-4fa6-83ab-93108a22a2a0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:14.700723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1057/2106] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:14.707034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7cd9-81ae-4762-884b-729428305e6b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:14.717495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7cd9-81ae-4762-884b-729428305e6b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:14.722476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f55a-9815-4071-afa8-9ff04dee67cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:14.723283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f55a-9815-4071-afa8-9ff04dee67cb admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.723584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f55a-9815-4071-afa8-9ff04dee67cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.723856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f55a-9815-4071-afa8-9ff04dee67cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.724593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42f55a-9815-4071-afa8-9ff04dee67cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:14.726262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42f55a-9815-4071-afa8-9ff04dee67cb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:14.736688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1050/2107] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:14.741390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4044c-c51e-4fa6-83ab-93108a22a2a0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:14.751809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4044c-c51e-4fa6-83ab-93108a22a2a0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:14.757567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7220c-1755-4809-ba7e-f2cbc656d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:14.758454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7220c-1755-4809-ba7e-f2cbc656d6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.758736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7220c-1755-4809-ba7e-f2cbc656d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.759035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7220c-1755-4809-ba7e-f2cbc656d6d7 admin admin] PATH_INFO: `/v3/projects/bd8b758e1a004f0da67f8475c4f2e8df/users/bf431de70ce843b98630778054c8dfed/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.777531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7220c-1755-4809-ba7e-f2cbc656d6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8b758e1a004f0da67f8475c4f2e8df, user_id=bf431de70ce843b98630778054c8dfed, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:14.780225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7220c-1755-4809-ba7e-f2cbc656d6d7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:14.802459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1058/2108] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:14 2022] PUT /identity/v3/projects/bd8b758e1a004f0da67f8475c4f2e8df/users/bf431de70ce843b98630778054c8dfed/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:14.820391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c5f2-e040-4157-8bbc-1db7353fc173 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:14.820777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c5f2-e040-4157-8bbc-1db7353fc173 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:14.821366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c5f2-e040-4157-8bbc-1db7353fc173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:14.849161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:14.854950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5da6c5f2-e040-4157-8bbc-1db7353fc173 None None] MFA Rules not processed for user `bf431de70ce843b98630778054c8dfed`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:14.856664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5da6c5f2-e040-4157-8bbc-1db7353fc173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:14.960252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1051/2109] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:14.965173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7220c-1755-4809-ba7e-f2cbc656d6d7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:15.103420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7220c-1755-4809-ba7e-f2cbc656d6d7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:15.108795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284962-5551-4a84-b359-8a5f523843da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:15.110018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284962-5551-4a84-b359-8a5f523843da admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.110018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284962-5551-4a84-b359-8a5f523843da admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.110394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284962-5551-4a84-b359-8a5f523843da admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.111154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b284962-5551-4a84-b359-8a5f523843da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:15.113198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b284962-5551-4a84-b359-8a5f523843da admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:15.158195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1059/2110] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:14 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:15.160233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c5f2-e040-4157-8bbc-1db7353fc173 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:15.174036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c5f2-e040-4157-8bbc-1db7353fc173 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:15.251661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee4c4-4037-4122-aeec-451a41517572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:15.251661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee4c4-4037-4122-aeec-451a41517572 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.251661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee4c4-4037-4122-aeec-451a41517572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.252166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee4c4-4037-4122-aeec-451a41517572 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.252671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ee4c4-4037-4122-aeec-451a41517572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:15.256086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ee4c4-4037-4122-aeec-451a41517572 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:15.279033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1052/2111] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:02:15 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:15.285009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284962-5551-4a84-b359-8a5f523843da admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:15.296299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284962-5551-4a84-b359-8a5f523843da admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:15.301463 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824233fb-94b3-4631-8ef6-e9aa68d9977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:15.302068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824233fb-94b3-4631-8ef6-e9aa68d9977f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.302359 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824233fb-94b3-4631-8ef6-e9aa68d9977f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.302755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824233fb-94b3-4631-8ef6-e9aa68d9977f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.303512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824233fb-94b3-4631-8ef6-e9aa68d9977f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:15.305501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824233fb-94b3-4631-8ef6-e9aa68d9977f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:15.318094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1060/2112] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:15.323842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee4c4-4037-4122-aeec-451a41517572 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:15.337230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee4c4-4037-4122-aeec-451a41517572 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:15.342423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a11c0-b206-4d65-83c6-aa850ab6a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:15.343360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a11c0-b206-4d65-83c6-aa850ab6a0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.343641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a11c0-b206-4d65-83c6-aa850ab6a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.343917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a11c0-b206-4d65-83c6-aa850ab6a0ab admin admin] PATH_INFO: `/v3/projects/0f315f38f5844f3da00bd26bec48a5b4/users/59c0ed3553344c9e8d20aa28e2c28f43/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.361591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a11c0-b206-4d65-83c6-aa850ab6a0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f315f38f5844f3da00bd26bec48a5b4, user_id=59c0ed3553344c9e8d20aa28e2c28f43, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:15.364831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a11c0-b206-4d65-83c6-aa850ab6a0ab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:15.382421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1053/2113] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:15 2022] PUT /identity/v3/projects/0f315f38f5844f3da00bd26bec48a5b4/users/59c0ed3553344c9e8d20aa28e2c28f43/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:15.386677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824233fb-94b3-4631-8ef6-e9aa68d9977f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:15.402951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824233fb-94b3-4631-8ef6-e9aa68d9977f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:15.483532 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279414db-655b-4a7c-bd51-e08665552bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:15.484513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279414db-655b-4a7c-bd51-e08665552bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.484513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279414db-655b-4a7c-bd51-e08665552bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.484831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279414db-655b-4a7c-bd51-e08665552bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.485476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279414db-655b-4a7c-bd51-e08665552bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:15.487111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279414db-655b-4a7c-bd51-e08665552bfe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:15.499043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1061/2114] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:15.503905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a11c0-b206-4d65-83c6-aa850ab6a0ab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:15.524098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a11c0-b206-4d65-83c6-aa850ab6a0ab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:15.531419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:15.532924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.533386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.533872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] PATH_INFO: `/v3/projects/0f315f38f5844f3da00bd26bec48a5b4/users/59c0ed3553344c9e8d20aa28e2c28f43/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.537290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f315f38f5844f3da00bd26bec48a5b4, user_id=59c0ed3553344c9e8d20aa28e2c28f43, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:15.542153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:15.561373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1054/2115] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:15 2022] PUT /identity/v3/projects/0f315f38f5844f3da00bd26bec48a5b4/users/59c0ed3553344c9e8d20aa28e2c28f43/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:15.572726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d23a-614b-45df-9c98-adee95dc8320 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.573026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d23a-614b-45df-9c98-adee95dc8320 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.573356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d23a-614b-45df-9c98-adee95dc8320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.580853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:15.603999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d7f6d23a-614b-45df-9c98-adee95dc8320 None None] MFA Rules not processed for user `59c0ed3553344c9e8d20aa28e2c28f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:15.605251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d7f6d23a-614b-45df-9c98-adee95dc8320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:15.693353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1062/2116] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:15.708962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:15.711106 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:15.798515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4da691-639e-43ea-93a7-9ba5d0746cc4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:15.803763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6aaf-c181-418b-9839-db1ffc55d747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:15.804523 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6aaf-c181-418b-9839-db1ffc55d747 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.804810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6aaf-c181-418b-9839-db1ffc55d747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.805093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6aaf-c181-418b-9839-db1ffc55d747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.815729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6aaf-c181-418b-9839-db1ffc55d747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:15.817895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6aaf-c181-418b-9839-db1ffc55d747 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:15.823205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:15.831409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1055/2117] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:15.860858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6d23a-614b-45df-9c98-adee95dc8320 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:15.955144 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6d23a-614b-45df-9c98-adee95dc8320 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:15.960817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:15.961926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:15.962217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:15.962497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] PATH_INFO: `/v3/users/bf431de70ce843b98630778054c8dfed` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:15.963760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf431de70ce843b98630778054c8dfed)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:15.965765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:16.031371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf431de70ce843b98630778054c8dfed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:16.032143 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf431de70ce843b98630778054c8dfed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:16.041532 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf431de70ce843b98630778054c8dfed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:16.051635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf431de70ce843b98630778054c8dfed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:16.052516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf431de70ce843b98630778054c8dfed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:16.075236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1063/2118] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:15 2022] DELETE /identity/v3/users/bf431de70ce843b98630778054c8dfed => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:16.079850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c02f-0848-4996-b342-52f333abf9ae None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:16.080145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c02f-0848-4996-b342-52f333abf9ae None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:16.080597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c02f-0848-4996-b342-52f333abf9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:16.101725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5417c02f-0848-4996-b342-52f333abf9ae None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:16.103859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5417c02f-0848-4996-b342-52f333abf9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:16.205482 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1056/2119] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:16.229879 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:16.235152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:16.252786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:16.360176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033a961-6858-4518-aca0-bcfa69501e6c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:16.364421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41d6b2-ef40-4fe7-825a-9be312df4fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:16.365690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41d6b2-ef40-4fe7-825a-9be312df4fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:16.365690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41d6b2-ef40-4fe7-825a-9be312df4fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:16.366041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41d6b2-ef40-4fe7-825a-9be312df4fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:16.378496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41d6b2-ef40-4fe7-825a-9be312df4fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:16.380475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41d6b2-ef40-4fe7-825a-9be312df4fc3 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:16.402952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1064/2120] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:17.184230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c02f-0848-4996-b342-52f333abf9ae None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:17.186911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5417c02f-0848-4996-b342-52f333abf9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:17.212255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c02f-0848-4996-b342-52f333abf9ae None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:17.236245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:17.237100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:17.237399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:17.238098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] PATH_INFO: `/v3/projects/bd8b758e1a004f0da67f8475c4f2e8df` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:17.239808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8b758e1a004f0da67f8475c4f2e8df)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:17.241855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:17.315578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8b758e1a004f0da67f8475c4f2e8df', 'request_id': 'req-5e331772-7c63-4d42-9162-e627f69b55af'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.325192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8b758e1a004f0da67f8475c4f2e8df', 'request_id': 'req-5e331772-7c63-4d42-9162-e627f69b55af'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.334254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8b758e1a004f0da67f8475c4f2e8df', 'request_id': 'req-5e331772-7c63-4d42-9162-e627f69b55af'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.349613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] The token cache is being invalidate because project bd8b758e1a004f0da67f8475c4f2e8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:17.349910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.350684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.355483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1057/2121] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:17 2022] DELETE /identity/v3/projects/bd8b758e1a004f0da67f8475c4f2e8df => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:17.356477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41d6b2-ef40-4fe7-825a-9be312df4fc3 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:17.376524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41d6b2-ef40-4fe7-825a-9be312df4fc3 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:17.479120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:17.480323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:17.480612 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:17.480968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] PATH_INFO: `/v3/users/59c0ed3553344c9e8d20aa28e2c28f43` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:17.482926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c0ed3553344c9e8d20aa28e2c28f43)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:17.485080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:17.573948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c0ed3553344c9e8d20aa28e2c28f43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.574995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c0ed3553344c9e8d20aa28e2c28f43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.588913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c0ed3553344c9e8d20aa28e2c28f43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.606041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c0ed3553344c9e8d20aa28e2c28f43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.606678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-89089fad-cf84-443c-a122-30a79ac43c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c0ed3553344c9e8d20aa28e2c28f43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:17.625454 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1065/2122] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:17 2022] DELETE /identity/v3/users/59c0ed3553344c9e8d20aa28e2c28f43 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:17.962148 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:17.963685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:17.977979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e331772-7c63-4d42-9162-e627f69b55af admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.058604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.059456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.059739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.060023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] PATH_INFO: `/v3/projects/0f315f38f5844f3da00bd26bec48a5b4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.061446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f315f38f5844f3da00bd26bec48a5b4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.063450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.089481 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:18.115637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f315f38f5844f3da00bd26bec48a5b4', 'request_id': 'req-a47551c5-37b2-46fd-ba17-3a89a51c36f6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:18.124014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f315f38f5844f3da00bd26bec48a5b4', 'request_id': 'req-a47551c5-37b2-46fd-ba17-3a89a51c36f6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:18.130063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f315f38f5844f3da00bd26bec48a5b4', 'request_id': 'req-a47551c5-37b2-46fd-ba17-3a89a51c36f6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:18.141168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] The token cache is being invalidate because project 0f315f38f5844f3da00bd26bec48a5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:18.141462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:18.142144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a47551c5-37b2-46fd-ba17-3a89a51c36f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:18.144303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1058/2123] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:17 2022] DELETE /identity/v3/projects/0f315f38f5844f3da00bd26bec48a5b4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:18.151321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58261-6feb-431d-b373-7fc4b39b2572 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.151621 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58261-6feb-431d-b373-7fc4b39b2572 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.151855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58261-6feb-431d-b373-7fc4b39b2572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.172062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-41f58261-6feb-431d-b373-7fc4b39b2572 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:18.173453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-41f58261-6feb-431d-b373-7fc4b39b2572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:18.204173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:18.243887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1066/2124] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:02:18.251444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe59974-ad23-4233-a96a-bb68b8b6ffa9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.251964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe59974-ad23-4233-a96a-bb68b8b6ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.252058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe59974-ad23-4233-a96a-bb68b8b6ffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.272363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-abe59974-ad23-4233-a96a-bb68b8b6ffa9 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:18.273619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-abe59974-ad23-4233-a96a-bb68b8b6ffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:18.282081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1059/2125] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:18.286837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f58261-6feb-431d-b373-7fc4b39b2572 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:18.297147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f58261-6feb-431d-b373-7fc4b39b2572 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.301973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.302687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.303031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.303361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.304146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:02:18.304509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.306237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.321131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1067/2126] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:02:18.326665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe59974-ad23-4233-a96a-bb68b8b6ffa9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:18.341629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe59974-ad23-4233-a96a-bb68b8b6ffa9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.346437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a3767-577b-4c24-a488-28ea6a4a65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.347240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a3767-577b-4c24-a488-28ea6a4a65fe admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.347675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a3767-577b-4c24-a488-28ea6a4a65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.347910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a3767-577b-4c24-a488-28ea6a4a65fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.350833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a3767-577b-4c24-a488-28ea6a4a65fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.350833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a3767-577b-4c24-a488-28ea6a4a65fe admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.377824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1060/2127] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:18 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:18.383356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:18.394476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96651c8-a199-48b7-91f1-dd6f8c110059 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.466150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef9230-7cb3-4843-8b0b-1c0d017d655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.466848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9230-7cb3-4843-8b0b-1c0d017d655e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.467133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9230-7cb3-4843-8b0b-1c0d017d655e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.467417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9230-7cb3-4843-8b0b-1c0d017d655e admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.468186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef9230-7cb3-4843-8b0b-1c0d017d655e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.470440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef9230-7cb3-4843-8b0b-1c0d017d655e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.493476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1068/2128] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:02:18 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:18.497518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a3767-577b-4c24-a488-28ea6a4a65fe admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:18.511629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a3767-577b-4c24-a488-28ea6a4a65fe admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.516444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d528e8-8fac-492c-ad8b-a18a643feec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.517162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d528e8-8fac-492c-ad8b-a18a643feec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.517450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d528e8-8fac-492c-ad8b-a18a643feec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.517765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d528e8-8fac-492c-ad8b-a18a643feec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.518710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d528e8-8fac-492c-ad8b-a18a643feec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.521584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d528e8-8fac-492c-ad8b-a18a643feec1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.540268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1061/2129] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:02:18.544604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef9230-7cb3-4843-8b0b-1c0d017d655e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:18.559108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef9230-7cb3-4843-8b0b-1c0d017d655e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.564107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1221525-d180-4372-85a0-5a340968e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.564787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1221525-d180-4372-85a0-5a340968e663 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.565077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1221525-d180-4372-85a0-5a340968e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.565370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1221525-d180-4372-85a0-5a340968e663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.566847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1221525-d180-4372-85a0-5a340968e663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.568455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1221525-d180-4372-85a0-5a340968e663 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.579625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1069/2130] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:18.584864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d528e8-8fac-492c-ad8b-a18a643feec1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:18.595460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d528e8-8fac-492c-ad8b-a18a643feec1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.600712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34deebda-c42f-4e2b-945b-d97139eb2164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.601657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deebda-c42f-4e2b-945b-d97139eb2164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.601982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deebda-c42f-4e2b-945b-d97139eb2164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.602213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deebda-c42f-4e2b-945b-d97139eb2164 admin admin] PATH_INFO: `/v3/projects/edceff2d021d45fa9bf84410b817643c/users/c70ead9180a642679d162b3b05cf0bcb/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.626438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34deebda-c42f-4e2b-945b-d97139eb2164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edceff2d021d45fa9bf84410b817643c, user_id=c70ead9180a642679d162b3b05cf0bcb, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.630840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34deebda-c42f-4e2b-945b-d97139eb2164 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.646877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1062/2131] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:18 2022] PUT /identity/v3/projects/edceff2d021d45fa9bf84410b817643c/users/c70ead9180a642679d162b3b05cf0bcb/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:18.658595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a294-bc19-46fd-8e12-2e262ab4d8d2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.658928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a294-bc19-46fd-8e12-2e262ab4d8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.659172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a294-bc19-46fd-8e12-2e262ab4d8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.688827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-da41a294-bc19-46fd-8e12-2e262ab4d8d2 None None] MFA Rules not processed for user `c70ead9180a642679d162b3b05cf0bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:18.690131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-da41a294-bc19-46fd-8e12-2e262ab4d8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:18.765467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1070/2132] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:18.770723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34deebda-c42f-4e2b-945b-d97139eb2164 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:18.839222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34deebda-c42f-4e2b-945b-d97139eb2164 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.843921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34b861-865f-4438-8ab3-b9fd009f3b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.844593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34b861-865f-4438-8ab3-b9fd009f3b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.844886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34b861-865f-4438-8ab3-b9fd009f3b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.845171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34b861-865f-4438-8ab3-b9fd009f3b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.845916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34b861-865f-4438-8ab3-b9fd009f3b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.848218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34b861-865f-4438-8ab3-b9fd009f3b36 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.879349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1063/2133] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:18 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:18.883570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a294-bc19-46fd-8e12-2e262ab4d8d2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:18.896960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a294-bc19-46fd-8e12-2e262ab4d8d2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:18.933817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:18.970525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8421e-52c4-4ee8-8535-520e910eb108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:18.971198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8421e-52c4-4ee8-8535-520e910eb108 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:18.971485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8421e-52c4-4ee8-8535-520e910eb108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:18.971822 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8421e-52c4-4ee8-8535-520e910eb108 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:18.972675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8421e-52c4-4ee8-8535-520e910eb108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:18.974724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8421e-52c4-4ee8-8535-520e910eb108 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:18.997111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1071/2134] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:02:18 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:02:19.001200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34b861-865f-4438-8ab3-b9fd009f3b36 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:19.012474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34b861-865f-4438-8ab3-b9fd009f3b36 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:19.017339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c2a7-1c9b-46f3-89d3-7771b0f12964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:19.018064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c2a7-1c9b-46f3-89d3-7771b0f12964 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:19.018348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c2a7-1c9b-46f3-89d3-7771b0f12964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:19.018709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c2a7-1c9b-46f3-89d3-7771b0f12964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:19.019581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c2a7-1c9b-46f3-89d3-7771b0f12964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:19.021214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c2a7-1c9b-46f3-89d3-7771b0f12964 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:19.033374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1064/2135] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:19.038412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8421e-52c4-4ee8-8535-520e910eb108 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:19.048647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8421e-52c4-4ee8-8535-520e910eb108 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:19.054251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb986b4-17dc-4669-a8ec-5c2e66a062d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:19.055151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb986b4-17dc-4669-a8ec-5c2e66a062d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:19.055444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb986b4-17dc-4669-a8ec-5c2e66a062d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:19.055732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb986b4-17dc-4669-a8ec-5c2e66a062d1 admin admin] PATH_INFO: `/v3/projects/d35ed2866f544af2b41a433890d7bf12/users/c804e519ab0a473dbed27a643e91c63e/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:19.074349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb986b4-17dc-4669-a8ec-5c2e66a062d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35ed2866f544af2b41a433890d7bf12, user_id=c804e519ab0a473dbed27a643e91c63e, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:19.077366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb986b4-17dc-4669-a8ec-5c2e66a062d1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:19.092297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1072/2136] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:19 2022] PUT /identity/v3/projects/d35ed2866f544af2b41a433890d7bf12/users/c804e519ab0a473dbed27a643e91c63e/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:19.096308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c2a7-1c9b-46f3-89d3-7771b0f12964 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:19.115654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c2a7-1c9b-46f3-89d3-7771b0f12964 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:19.139062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:19.182069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28a937-ec53-476a-b3ce-8de8e30e8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:19.182805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a937-ec53-476a-b3ce-8de8e30e8956 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:19.183059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a937-ec53-476a-b3ce-8de8e30e8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:19.183349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a937-ec53-476a-b3ce-8de8e30e8956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:19.184089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28a937-ec53-476a-b3ce-8de8e30e8956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:19.185862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28a937-ec53-476a-b3ce-8de8e30e8956 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:19.196574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1065/2137] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:19.201310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb986b4-17dc-4669-a8ec-5c2e66a062d1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:19.213711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb986b4-17dc-4669-a8ec-5c2e66a062d1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:19.219456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:19.220370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:19.220662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:19.220948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] PATH_INFO: `/v3/projects/d35ed2866f544af2b41a433890d7bf12/users/c804e519ab0a473dbed27a643e91c63e/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:19.223656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35ed2866f544af2b41a433890d7bf12, user_id=c804e519ab0a473dbed27a643e91c63e, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:19.226370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:19.237445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1073/2138] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:19 2022] PUT /identity/v3/projects/d35ed2866f544af2b41a433890d7bf12/users/c804e519ab0a473dbed27a643e91c63e/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:19.248835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9359-a151-416f-833e-8e5a7de53293 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:19.249130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9359-a151-416f-833e-8e5a7de53293 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:19.249418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9359-a151-416f-833e-8e5a7de53293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:19.277440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-483b9359-a151-416f-833e-8e5a7de53293 None None] MFA Rules not processed for user `c804e519ab0a473dbed27a643e91c63e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:19.278700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-483b9359-a151-416f-833e-8e5a7de53293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:19.358116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1066/2139] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:19.376093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:19.378703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:19.446973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7a2e-91d9-45e1-84a0-3b410ef766f3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:19.450747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96790b40-8843-419c-a634-8896e931a70c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:19.451419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790b40-8843-419c-a634-8896e931a70c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:19.451708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790b40-8843-419c-a634-8896e931a70c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:19.451996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790b40-8843-419c-a634-8896e931a70c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:19.464435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96790b40-8843-419c-a634-8896e931a70c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:19.465942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96790b40-8843-419c-a634-8896e931a70c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:19.477478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1074/2140] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:19.887138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b9359-a151-416f-833e-8e5a7de53293 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:19.898066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b9359-a151-416f-833e-8e5a7de53293 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:19.902654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c804e519ab0a473dbed27a643e91c63e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd35ed2866f544af2b41a433890d7bf12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:19.903329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:19.903616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:19.903898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:19.904646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:02:19.904944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:19.906592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:19.920172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1067/2141] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:02:19.925111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96790b40-8843-419c-a634-8896e931a70c service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:19.941002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96790b40-8843-419c-a634-8896e931a70c service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:19.948420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a1bf9-13fb-4c8d-87a7-ff4d3902b3c0 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c804e519ab0a473dbed27a643e91c63e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd35ed2866f544af2b41a433890d7bf12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:19.949710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1bf9-13fb-4c8d-87a7-ff4d3902b3c0 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:19.950331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1bf9-13fb-4c8d-87a7-ff4d3902b3c0 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:19.950928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1bf9-13fb-4c8d-87a7-ff4d3902b3c0 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:19.952347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a1bf9-13fb-4c8d-87a7-ff4d3902b3c0 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:19.957004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a1bf9-13fb-4c8d-87a7-ff4d3902b3c0 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:19.992964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1075/2142] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:19 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:02:19.994810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:20.006301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80e251-c785-4816-9acf-fb86323de3e5 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:20.079919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c804e519ab0a473dbed27a643e91c63e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd35ed2866f544af2b41a433890d7bf12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:20.080628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:20.080923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:20.081864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:20.082657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:02:20.082929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:20.084557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:20.097174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1068/2143] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:02:20.141467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a1bf9-13fb-4c8d-87a7-ff4d3902b3c0 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:20.153556 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a1bf9-13fb-4c8d-87a7-ff4d3902b3c0 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:20.158815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c804e519ab0a473dbed27a643e91c63e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd35ed2866f544af2b41a433890d7bf12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:20.159964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:20.160253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:20.160541 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] PATH_INFO: `/v3/projects/282ed76201ec485bbb8e687521c147bb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:20.162339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Authorizing `identity:delete_project(project_id=282ed76201ec485bbb8e687521c147bb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:20.164286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:20.218245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282ed76201ec485bbb8e687521c147bb', 'request_id': 'req-5941841f-463d-461e-b406-244ea14e01a1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.224877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282ed76201ec485bbb8e687521c147bb', 'request_id': 'req-5941841f-463d-461e-b406-244ea14e01a1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.226783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:20.234439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282ed76201ec485bbb8e687521c147bb', 'request_id': 'req-5941841f-463d-461e-b406-244ea14e01a1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.249188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] The token cache is being invalidate because project 282ed76201ec485bbb8e687521c147bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:20.249488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.250200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5941841f-463d-461e-b406-244ea14e01a1 tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.251779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1076/2144] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:20 2022] DELETE /identity/v3/projects/282ed76201ec485bbb8e687521c147bb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:20.463551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:20.465448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:20.506523 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:20.561708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd66e-18ad-4f19-ad22-7557aaf3143e tempest-VolumeQuotaClassesTest-1675433513 tempest-VolumeQuotaClassesTest-1675433513-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:20.631323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:20.632245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:20.632535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:20.632822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] PATH_INFO: `/v3/users/c70ead9180a642679d162b3b05cf0bcb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:20.634134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70ead9180a642679d162b3b05cf0bcb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:20.636105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:20.688142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70ead9180a642679d162b3b05cf0bcb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.688802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70ead9180a642679d162b3b05cf0bcb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.699136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70ead9180a642679d162b3b05cf0bcb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.717874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70ead9180a642679d162b3b05cf0bcb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.726385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70ead9180a642679d162b3b05cf0bcb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:20.737087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1069/2145] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:20 2022] DELETE /identity/v3/users/c70ead9180a642679d162b3b05cf0bcb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:20.742091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8752f8-0dbf-46be-b059-859466977d93 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:20.742647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8752f8-0dbf-46be-b059-859466977d93 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:20.742647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8752f8-0dbf-46be-b059-859466977d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:20.760874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3a8752f8-0dbf-46be-b059-859466977d93 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:20.762137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3a8752f8-0dbf-46be-b059-859466977d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:20.830921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1077/2146] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:20.841813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:20.843298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:20.915821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9acd8-957b-4abf-b05c-de52fcc6ed98 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:20.919973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20b34-b120-4163-929d-bb8726edea5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:20.920667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20b34-b120-4163-929d-bb8726edea5d service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:20.920961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20b34-b120-4163-929d-bb8726edea5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:20.921251 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20b34-b120-4163-929d-bb8726edea5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:20.928202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:20.934808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb20b34-b120-4163-929d-bb8726edea5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:20.938942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb20b34-b120-4163-929d-bb8726edea5d service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:20.952510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1070/2147] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:21.342741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8752f8-0dbf-46be-b059-859466977d93 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:21.344221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3a8752f8-0dbf-46be-b059-859466977d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:21.358051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8752f8-0dbf-46be-b059-859466977d93 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:21.363761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:21.364804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:21.365163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:21.365521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] PATH_INFO: `/v3/projects/edceff2d021d45fa9bf84410b817643c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:21.367245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edceff2d021d45fa9bf84410b817643c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:21.369911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:21.441811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edceff2d021d45fa9bf84410b817643c', 'request_id': 'req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.448398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edceff2d021d45fa9bf84410b817643c', 'request_id': 'req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.457126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edceff2d021d45fa9bf84410b817643c', 'request_id': 'req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.468346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] The token cache is being invalidate because project edceff2d021d45fa9bf84410b817643c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:21.468643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.469318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.470920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1078/2148] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:21 2022] DELETE /identity/v3/projects/edceff2d021d45fa9bf84410b817643c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:21.475662 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20b34-b120-4163-929d-bb8726edea5d service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:21.491663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20b34-b120-4163-929d-bb8726edea5d service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:21.553187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:21.554114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:21.554388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:21.554660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] PATH_INFO: `/v3/users/c804e519ab0a473dbed27a643e91c63e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:21.555865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c804e519ab0a473dbed27a643e91c63e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:21.557852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:21.616334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c804e519ab0a473dbed27a643e91c63e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.617022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c804e519ab0a473dbed27a643e91c63e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.626345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c804e519ab0a473dbed27a643e91c63e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.640398 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c804e519ab0a473dbed27a643e91c63e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.647503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cb66dfe-ab1e-4ebd-ab7f-98393e1ffd2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c804e519ab0a473dbed27a643e91c63e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:21.654427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1071/2149] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:21 2022] DELETE /identity/v3/users/c804e519ab0a473dbed27a643e91c63e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:21.990376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:21.991835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:22.005218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce1aa7-e673-4a65-8abf-0f655a4c75d9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:22.091656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:22.093117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.093430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.093907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] PATH_INFO: `/v3/projects/d35ed2866f544af2b41a433890d7bf12` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.098861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35ed2866f544af2b41a433890d7bf12)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:22.101049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:22.115966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:22.174063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35ed2866f544af2b41a433890d7bf12', 'request_id': 'req-66c52bc9-fc17-4ea3-bc83-efc4d356f738'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:22.182410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35ed2866f544af2b41a433890d7bf12', 'request_id': 'req-66c52bc9-fc17-4ea3-bc83-efc4d356f738'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:22.191211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35ed2866f544af2b41a433890d7bf12', 'request_id': 'req-66c52bc9-fc17-4ea3-bc83-efc4d356f738'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:22.202137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] The token cache is being invalidate because project d35ed2866f544af2b41a433890d7bf12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:22.202414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:22.203050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-66c52bc9-fc17-4ea3-bc83-efc4d356f738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:22.204607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1079/2150] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:21 2022] DELETE /identity/v3/projects/d35ed2866f544af2b41a433890d7bf12 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:22.209677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf585958-48a5-4762-91e7-04f2b2f16610 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.209980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf585958-48a5-4762-91e7-04f2b2f16610 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.210263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf585958-48a5-4762-91e7-04f2b2f16610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.231584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bf585958-48a5-4762-91e7-04f2b2f16610 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:22.232810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf585958-48a5-4762-91e7-04f2b2f16610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:22.325602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1072/2151] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:22.327402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1023-3e40-4094-93b6-b1f34a3f8b43 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.327694 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1023-3e40-4094-93b6-b1f34a3f8b43 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.327998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1023-3e40-4094-93b6-b1f34a3f8b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.348114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b17e1023-3e40-4094-93b6-b1f34a3f8b43 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:22.349340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b17e1023-3e40-4094-93b6-b1f34a3f8b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:22.357584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1080/2152] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:22.361703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf585958-48a5-4762-91e7-04f2b2f16610 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:22.378042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf585958-48a5-4762-91e7-04f2b2f16610 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:22.384221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:22.384911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.385307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.385467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.386328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:02:22.386647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:22.388268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:22.399029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:22.403127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1073/2153] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:02:22.408381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1023-3e40-4094-93b6-b1f34a3f8b43 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:22.420122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1023-3e40-4094-93b6-b1f34a3f8b43 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:22.425695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2b13-20b3-4cd1-a0f3-80ee1450e550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:22.426380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2b13-20b3-4cd1-a0f3-80ee1450e550 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.426665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2b13-20b3-4cd1-a0f3-80ee1450e550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.426946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2b13-20b3-4cd1-a0f3-80ee1450e550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.427659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2b13-20b3-4cd1-a0f3-80ee1450e550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:22.429636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2b13-20b3-4cd1-a0f3-80ee1450e550 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:22.455777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1081/2154] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:22 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:22.460645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:22.471055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237dc77-15f7-4d5d-9db4-9415db80487b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:22.536130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db1f9-e2ca-46a2-8ee9-5df0b472d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:22.537085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db1f9-e2ca-46a2-8ee9-5df0b472d6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.537190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db1f9-e2ca-46a2-8ee9-5df0b472d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.537449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db1f9-e2ca-46a2-8ee9-5df0b472d6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.538794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04db1f9-e2ca-46a2-8ee9-5df0b472d6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:22.540795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04db1f9-e2ca-46a2-8ee9-5df0b472d6c8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:22.561831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1074/2155] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:02:22 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:22.566048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2b13-20b3-4cd1-a0f3-80ee1450e550 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:22.576635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2b13-20b3-4cd1-a0f3-80ee1450e550 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:22.581879 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155827-ad99-4c50-9d6f-bcd75a8cd202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:22.582699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155827-ad99-4c50-9d6f-bcd75a8cd202 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.582930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155827-ad99-4c50-9d6f-bcd75a8cd202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.583210 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155827-ad99-4c50-9d6f-bcd75a8cd202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.583948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155827-ad99-4c50-9d6f-bcd75a8cd202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:22.585562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155827-ad99-4c50-9d6f-bcd75a8cd202 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:22.597354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1082/2156] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:22.602499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db1f9-e2ca-46a2-8ee9-5df0b472d6c8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:22.617960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db1f9-e2ca-46a2-8ee9-5df0b472d6c8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:22.623422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb46c74-c8c8-4968-8dbc-557fdeedf5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:22.624113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb46c74-c8c8-4968-8dbc-557fdeedf5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.624403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb46c74-c8c8-4968-8dbc-557fdeedf5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.624688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb46c74-c8c8-4968-8dbc-557fdeedf5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.625427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb46c74-c8c8-4968-8dbc-557fdeedf5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:22.632689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb46c74-c8c8-4968-8dbc-557fdeedf5ae admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:22.639954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1075/2157] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:22.648545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155827-ad99-4c50-9d6f-bcd75a8cd202 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:22.664700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155827-ad99-4c50-9d6f-bcd75a8cd202 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:22.671988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af05987-868a-4589-afc5-7d586d595851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:22.673495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af05987-868a-4589-afc5-7d586d595851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.674010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af05987-868a-4589-afc5-7d586d595851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.674486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af05987-868a-4589-afc5-7d586d595851 admin admin] PATH_INFO: `/v3/projects/70c651fab4844482b09996a5f13ebbab/users/cd8d354a03a84ca495f7052ca26f3f30/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.706974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af05987-868a-4589-afc5-7d586d595851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c651fab4844482b09996a5f13ebbab, user_id=cd8d354a03a84ca495f7052ca26f3f30, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:22.709919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af05987-868a-4589-afc5-7d586d595851 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:22.735400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1083/2158] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:22 2022] PUT /identity/v3/projects/70c651fab4844482b09996a5f13ebbab/users/cd8d354a03a84ca495f7052ca26f3f30/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:22.758269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd75073-f83e-4d78-9a80-02bd4822e99e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.758942 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd75073-f83e-4d78-9a80-02bd4822e99e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.765630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd75073-f83e-4d78-9a80-02bd4822e99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.802012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7cd75073-f83e-4d78-9a80-02bd4822e99e None None] MFA Rules not processed for user `cd8d354a03a84ca495f7052ca26f3f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:22.803232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7cd75073-f83e-4d78-9a80-02bd4822e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:22.880802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1076/2159] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:22.887998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af05987-868a-4589-afc5-7d586d595851 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:22.974966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af05987-868a-4589-afc5-7d586d595851 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:22.979884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214929b5-592d-472d-818f-9aad6075d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:22.980558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214929b5-592d-472d-818f-9aad6075d3bf admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:22.980852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214929b5-592d-472d-818f-9aad6075d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:22.981135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214929b5-592d-472d-818f-9aad6075d3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:22.981930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214929b5-592d-472d-818f-9aad6075d3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:22.983855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214929b5-592d-472d-818f-9aad6075d3bf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:23.015337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1084/2160] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:22 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:23.016843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd75073-f83e-4d78-9a80-02bd4822e99e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:23.029098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd75073-f83e-4d78-9a80-02bd4822e99e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:23.097238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d1ca2-a6ab-4c9a-8029-bdefacd6f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:23.097871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d1ca2-a6ab-4c9a-8029-bdefacd6f4cd admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:23.098164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d1ca2-a6ab-4c9a-8029-bdefacd6f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:23.098463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d1ca2-a6ab-4c9a-8029-bdefacd6f4cd admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:23.099172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d1ca2-a6ab-4c9a-8029-bdefacd6f4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:23.101140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d1ca2-a6ab-4c9a-8029-bdefacd6f4cd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:23.117827 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:23.128884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1077/2161] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:02:23 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:23.130757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214929b5-592d-472d-818f-9aad6075d3bf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:23.142096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214929b5-592d-472d-818f-9aad6075d3bf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:23.147388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db3bd1-3a94-441c-81ac-830b2168c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:23.148273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3bd1-3a94-441c-81ac-830b2168c7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:23.148640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3bd1-3a94-441c-81ac-830b2168c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:23.149077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3bd1-3a94-441c-81ac-830b2168c7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:23.150021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db3bd1-3a94-441c-81ac-830b2168c7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:23.151904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db3bd1-3a94-441c-81ac-830b2168c7b5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:23.167861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1085/2162] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:23.172592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d1ca2-a6ab-4c9a-8029-bdefacd6f4cd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:23.183197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d1ca2-a6ab-4c9a-8029-bdefacd6f4cd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:23.188907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014093f-1ee3-4bb9-b720-411740e42683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:23.189863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014093f-1ee3-4bb9-b720-411740e42683 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:23.190153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014093f-1ee3-4bb9-b720-411740e42683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:23.191270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014093f-1ee3-4bb9-b720-411740e42683 admin admin] PATH_INFO: `/v3/projects/f511dab70e5a4e67a33c47d1b7caebb0/users/53fc12c2ce814eadb9273e440037ef4c/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:23.210066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014093f-1ee3-4bb9-b720-411740e42683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f511dab70e5a4e67a33c47d1b7caebb0, user_id=53fc12c2ce814eadb9273e440037ef4c, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:23.212796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014093f-1ee3-4bb9-b720-411740e42683 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:23.228269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1078/2163] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:23 2022] PUT /identity/v3/projects/f511dab70e5a4e67a33c47d1b7caebb0/users/53fc12c2ce814eadb9273e440037ef4c/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:23.232343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db3bd1-3a94-441c-81ac-830b2168c7b5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:23.243800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db3bd1-3a94-441c-81ac-830b2168c7b5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:23.249043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:23.309003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160534e-515b-4345-8277-35a9cbb949e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:23.309314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160534e-515b-4345-8277-35a9cbb949e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:23.309643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160534e-515b-4345-8277-35a9cbb949e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:23.309947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160534e-515b-4345-8277-35a9cbb949e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:23.310725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160534e-515b-4345-8277-35a9cbb949e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:23.312348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160534e-515b-4345-8277-35a9cbb949e9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:23.325016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1086/2164] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:23.330803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014093f-1ee3-4bb9-b720-411740e42683 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:23.342201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014093f-1ee3-4bb9-b720-411740e42683 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:23.347146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:23.348123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:23.348349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:23.348631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] PATH_INFO: `/v3/projects/f511dab70e5a4e67a33c47d1b7caebb0/users/53fc12c2ce814eadb9273e440037ef4c/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:23.350749 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f511dab70e5a4e67a33c47d1b7caebb0, user_id=53fc12c2ce814eadb9273e440037ef4c, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:23.353483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:23.372125 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1079/2165] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:23 2022] PUT /identity/v3/projects/f511dab70e5a4e67a33c47d1b7caebb0/users/53fc12c2ce814eadb9273e440037ef4c/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:23.383329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf75fb-97d8-4bdc-abf3-dc6cd7f81b7b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:23.383566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf75fb-97d8-4bdc-abf3-dc6cd7f81b7b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:23.383816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf75fb-97d8-4bdc-abf3-dc6cd7f81b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:23.420968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-26cf75fb-97d8-4bdc-abf3-dc6cd7f81b7b None None] MFA Rules not processed for user `53fc12c2ce814eadb9273e440037ef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:23.422335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-26cf75fb-97d8-4bdc-abf3-dc6cd7f81b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:23.532239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1087/2166] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:23.548872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:23.551652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:23.658378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f839d-7a50-4a9c-8413-5291c8b6fac9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:23.662570 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afee94-cdd4-4b3a-ae17-244e249d9653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:23.663233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afee94-cdd4-4b3a-ae17-244e249d9653 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:23.663559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afee94-cdd4-4b3a-ae17-244e249d9653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:23.663841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afee94-cdd4-4b3a-ae17-244e249d9653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:23.674236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afee94-cdd4-4b3a-ae17-244e249d9653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:23.675755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afee94-cdd4-4b3a-ae17-244e249d9653 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:23.685966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1080/2167] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:23.824751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf75fb-97d8-4bdc-abf3-dc6cd7f81b7b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:23.897412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf75fb-97d8-4bdc-abf3-dc6cd7f81b7b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:23.902042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:23.902990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:23.903280 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:23.903564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] PATH_INFO: `/v3/users/cd8d354a03a84ca495f7052ca26f3f30` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:23.904790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8d354a03a84ca495f7052ca26f3f30)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:23.906793 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:23.949962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:23.966164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8d354a03a84ca495f7052ca26f3f30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:23.966891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8d354a03a84ca495f7052ca26f3f30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:23.974888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8d354a03a84ca495f7052ca26f3f30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:23.984861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8d354a03a84ca495f7052ca26f3f30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:23.985658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8d354a03a84ca495f7052ca26f3f30'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.005850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1088/2168] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:23 2022] DELETE /identity/v3/users/cd8d354a03a84ca495f7052ca26f3f30 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:24.011257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dffa1-de17-4fc2-8cf9-ff08b72a4f8a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:24.011555 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dffa1-de17-4fc2-8cf9-ff08b72a4f8a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:24.011843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dffa1-de17-4fc2-8cf9-ff08b72a4f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:24.029855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-da1dffa1-de17-4fc2-8cf9-ff08b72a4f8a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:24.031087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-da1dffa1-de17-4fc2-8cf9-ff08b72a4f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:24.105911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1081/2169] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:24.116662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:24.118384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:24.188075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbb375-e0fd-4465-8ea5-a40aeef3fc76 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:24.192393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5db89-fe1e-4b27-ac3c-6b6c8a16f31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:24.193093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5db89-fe1e-4b27-ac3c-6b6c8a16f31b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:24.193405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5db89-fe1e-4b27-ac3c-6b6c8a16f31b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:24.193733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5db89-fe1e-4b27-ac3c-6b6c8a16f31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:24.206242 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5db89-fe1e-4b27-ac3c-6b6c8a16f31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:24.207863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5db89-fe1e-4b27-ac3c-6b6c8a16f31b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:24.218217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1089/2170] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:24.547248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dffa1-de17-4fc2-8cf9-ff08b72a4f8a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:24.548957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-da1dffa1-de17-4fc2-8cf9-ff08b72a4f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:24.567712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dffa1-de17-4fc2-8cf9-ff08b72a4f8a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:24.573196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:24.574308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:24.574610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:24.574949 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] PATH_INFO: `/v3/projects/70c651fab4844482b09996a5f13ebbab` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:24.579048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c651fab4844482b09996a5f13ebbab)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:24.579048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:24.627501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:24.641974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c651fab4844482b09996a5f13ebbab', 'request_id': 'req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.661183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c651fab4844482b09996a5f13ebbab', 'request_id': 'req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.673861 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c651fab4844482b09996a5f13ebbab', 'request_id': 'req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.693914 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] The token cache is being invalidate because project 70c651fab4844482b09996a5f13ebbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:24.694547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.695723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.700733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1082/2171] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:24 2022] DELETE /identity/v3/projects/70c651fab4844482b09996a5f13ebbab => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:24.704819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5db89-fe1e-4b27-ac3c-6b6c8a16f31b service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:24.720375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5db89-fe1e-4b27-ac3c-6b6c8a16f31b service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:24.835981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:24.836923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:24.837214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:24.837495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] PATH_INFO: `/v3/users/53fc12c2ce814eadb9273e440037ef4c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:24.839479 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fc12c2ce814eadb9273e440037ef4c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:24.842090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:24.913698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fc12c2ce814eadb9273e440037ef4c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.914557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fc12c2ce814eadb9273e440037ef4c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.921014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:24.924293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fc12c2ce814eadb9273e440037ef4c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.944867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fc12c2ce814eadb9273e440037ef4c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.946020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7cd819a9-39fd-4a5e-a840-fce4b9470a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fc12c2ce814eadb9273e440037ef4c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:24.966219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1090/2172] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:24 2022] DELETE /identity/v3/users/53fc12c2ce814eadb9273e440037ef4c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:25.282553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:25.284572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:25.300992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57290e6c-d68d-4af5-a1f7-4846c82c2a1c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:25.388167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:25.389076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.389361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.389673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] PATH_INFO: `/v3/projects/f511dab70e5a4e67a33c47d1b7caebb0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.390935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f511dab70e5a4e67a33c47d1b7caebb0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:25.392884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:25.450697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f511dab70e5a4e67a33c47d1b7caebb0', 'request_id': 'req-55e9751b-fa80-48b1-adbd-0ca74289763c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:25.460175 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f511dab70e5a4e67a33c47d1b7caebb0', 'request_id': 'req-55e9751b-fa80-48b1-adbd-0ca74289763c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:25.469183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f511dab70e5a4e67a33c47d1b7caebb0', 'request_id': 'req-55e9751b-fa80-48b1-adbd-0ca74289763c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:25.483356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] The token cache is being invalidate because project f511dab70e5a4e67a33c47d1b7caebb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:25.483552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:25.484191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e9751b-fa80-48b1-adbd-0ca74289763c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:25.485781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1083/2173] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:25 2022] DELETE /identity/v3/projects/f511dab70e5a4e67a33c47d1b7caebb0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:25.490995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323c98-29c2-4436-b41e-de19388dd3fe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.491985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323c98-29c2-4436-b41e-de19388dd3fe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.491985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323c98-29c2-4436-b41e-de19388dd3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.510410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-93323c98-29c2-4436-b41e-de19388dd3fe None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:25.511646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-93323c98-29c2-4436-b41e-de19388dd3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:25.577623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1091/2174] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:02:25.586229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ae741-cce9-4ec8-8b8c-4703b3027761 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.586753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ae741-cce9-4ec8-8b8c-4703b3027761 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.586842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ae741-cce9-4ec8-8b8c-4703b3027761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.606141 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bb4ae741-cce9-4ec8-8b8c-4703b3027761 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:25.607436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb4ae741-cce9-4ec8-8b8c-4703b3027761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:25.615639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1084/2175] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:25.620096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323c98-29c2-4436-b41e-de19388dd3fe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:25.631293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323c98-29c2-4436-b41e-de19388dd3fe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:25.639266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:25.639959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.640251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.640538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.641306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:02:25.641644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:25.643282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:25.656579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1092/2176] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:02:25.662033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ae741-cce9-4ec8-8b8c-4703b3027761 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:25.671343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ae741-cce9-4ec8-8b8c-4703b3027761 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:25.676691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12820-8ab6-4b8d-9f11-4d090ed96900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:25.677392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12820-8ab6-4b8d-9f11-4d090ed96900 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.677700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12820-8ab6-4b8d-9f11-4d090ed96900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.677979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12820-8ab6-4b8d-9f11-4d090ed96900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.678684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa12820-8ab6-4b8d-9f11-4d090ed96900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:25.680742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa12820-8ab6-4b8d-9f11-4d090ed96900 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:25.711236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1085/2177] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:25 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:25.716279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:25.736365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2867-e4c0-423a-89a6-6d8e1b00c412 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:25.797066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d03e20-0521-4ac9-9651-c9f97e43ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:25.797778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d03e20-0521-4ac9-9651-c9f97e43ea73 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.798064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d03e20-0521-4ac9-9651-c9f97e43ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.798342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d03e20-0521-4ac9-9651-c9f97e43ea73 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.799033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d03e20-0521-4ac9-9651-c9f97e43ea73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:25.801683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d03e20-0521-4ac9-9651-c9f97e43ea73 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:25.823184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1093/2178] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:02:25 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:25.828620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12820-8ab6-4b8d-9f11-4d090ed96900 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:25.840232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12820-8ab6-4b8d-9f11-4d090ed96900 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:25.845648 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd670-f23b-4f58-9436-996c162bc33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:25.846735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd670-f23b-4f58-9436-996c162bc33d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.847081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd670-f23b-4f58-9436-996c162bc33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.847374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd670-f23b-4f58-9436-996c162bc33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.848373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fd670-f23b-4f58-9436-996c162bc33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:25.850441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fd670-f23b-4f58-9436-996c162bc33d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:25.866789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1086/2179] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:25.868326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d03e20-0521-4ac9-9651-c9f97e43ea73 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:25.879847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d03e20-0521-4ac9-9651-c9f97e43ea73 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:25.884859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b8550-aa23-4067-914a-632398dc1e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:25.885618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8550-aa23-4067-914a-632398dc1e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.885932 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8550-aa23-4067-914a-632398dc1e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.886245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8550-aa23-4067-914a-632398dc1e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.886989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b8550-aa23-4067-914a-632398dc1e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:25.888610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b8550-aa23-4067-914a-632398dc1e97 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:25.899850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1094/2180] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:02:25.904110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd670-f23b-4f58-9436-996c162bc33d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:25.917834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd670-f23b-4f58-9436-996c162bc33d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:25.922670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:25.923580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.923867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.924179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] PATH_INFO: `/v3/projects/1fcbc435ee874db385e0876205dc0b5c/users/b31a986d4a184c07972ee8bdea2d36ee/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:25.941968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcbc435ee874db385e0876205dc0b5c, user_id=b31a986d4a184c07972ee8bdea2d36ee, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:25.944949 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:25.947652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:25.963728 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1087/2181] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:25 2022] PUT /identity/v3/projects/1fcbc435ee874db385e0876205dc0b5c/users/b31a986d4a184c07972ee8bdea2d36ee/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:25.975798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ca2df-2773-4aa8-a2fe-903964ab9a3e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:25.976258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ca2df-2773-4aa8-a2fe-903964ab9a3e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:25.976590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ca2df-2773-4aa8-a2fe-903964ab9a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:26.015728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-709ca2df-2773-4aa8-a2fe-903964ab9a3e None None] MFA Rules not processed for user `b31a986d4a184c07972ee8bdea2d36ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:26.016936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-709ca2df-2773-4aa8-a2fe-903964ab9a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:26.050388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:26.103129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1095/2182] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:26.118214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:26.120002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:26.189018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc30663-20c2-4877-b633-8f0677846240 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:26.194385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d03de-9f3c-4820-a553-e55c0463b0ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:26.195153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d03de-9f3c-4820-a553-e55c0463b0ed service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:26.195446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d03de-9f3c-4820-a553-e55c0463b0ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:26.195762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d03de-9f3c-4820-a553-e55c0463b0ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:26.209287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d03de-9f3c-4820-a553-e55c0463b0ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:26.210814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d03de-9f3c-4820-a553-e55c0463b0ed service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:26.230375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1088/2183] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:29.397588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ca2df-2773-4aa8-a2fe-903964ab9a3e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:29.488803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ca2df-2773-4aa8-a2fe-903964ab9a3e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:29.493838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:29.494737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:29.495025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:29.495308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] PATH_INFO: `/v3/users/b31a986d4a184c07972ee8bdea2d36ee` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:29.496534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31a986d4a184c07972ee8bdea2d36ee)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:29.498539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:29.573139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31a986d4a184c07972ee8bdea2d36ee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:29.573909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31a986d4a184c07972ee8bdea2d36ee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:29.582760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31a986d4a184c07972ee8bdea2d36ee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:29.591791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31a986d4a184c07972ee8bdea2d36ee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:29.592586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31a986d4a184c07972ee8bdea2d36ee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:29.612038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1096/2184] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:29 2022] DELETE /identity/v3/users/b31a986d4a184c07972ee8bdea2d36ee => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:02:29.617039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca126-5786-4d45-a055-a890d5ef8d63 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:29.617842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca126-5786-4d45-a055-a890d5ef8d63 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:29.617842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca126-5786-4d45-a055-a890d5ef8d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:29.640810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0c1ca126-5786-4d45-a055-a890d5ef8d63 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:29.642180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c1ca126-5786-4d45-a055-a890d5ef8d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:29.718062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1089/2185] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:29.729456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:29.731505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:29.803792 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:29.819226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41327948-4902-4f64-a8f7-8a8fa1e2fbaa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:29.823154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9221-1342-43bf-a34e-201f947c375c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:29.824360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9221-1342-43bf-a34e-201f947c375c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:29.824360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9221-1342-43bf-a34e-201f947c375c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:29.824678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9221-1342-43bf-a34e-201f947c375c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:29.835227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9221-1342-43bf-a34e-201f947c375c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:29.836970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9221-1342-43bf-a34e-201f947c375c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:29.847716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1097/2186] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:30.216226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ca126-5786-4d45-a055-a890d5ef8d63 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:30.218395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c1ca126-5786-4d45-a055-a890d5ef8d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:30.245065 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ca126-5786-4d45-a055-a890d5ef8d63 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:30.255003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:30.256082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.256438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.256918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] PATH_INFO: `/v3/projects/1fcbc435ee874db385e0876205dc0b5c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.258441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fcbc435ee874db385e0876205dc0b5c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:30.260498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:30.328150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fcbc435ee874db385e0876205dc0b5c', 'request_id': 'req-63f3ec43-264f-4dd7-9eb5-376406d96bdf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:30.338182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fcbc435ee874db385e0876205dc0b5c', 'request_id': 'req-63f3ec43-264f-4dd7-9eb5-376406d96bdf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:30.345179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fcbc435ee874db385e0876205dc0b5c', 'request_id': 'req-63f3ec43-264f-4dd7-9eb5-376406d96bdf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:30.363458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] The token cache is being invalidate because project 1fcbc435ee874db385e0876205dc0b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:30.364038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:30.364789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63f3ec43-264f-4dd7-9eb5-376406d96bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:30.366583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1090/2187] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:30 2022] DELETE /identity/v3/projects/1fcbc435ee874db385e0876205dc0b5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:30.372083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac61f-396d-4f32-ac06-482aed43568a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.372416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac61f-396d-4f32-ac06-482aed43568a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.372795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac61f-396d-4f32-ac06-482aed43568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.394889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f8dac61f-396d-4f32-ac06-482aed43568a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:30.396807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8dac61f-396d-4f32-ac06-482aed43568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:30.488485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1098/2188] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:30.498150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d30e5-3a6b-4594-ac67-b34f89cdb533 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.498624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d30e5-3a6b-4594-ac67-b34f89cdb533 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.499084 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d30e5-3a6b-4594-ac67-b34f89cdb533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.521206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-058d30e5-3a6b-4594-ac67-b34f89cdb533 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:30.522680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-058d30e5-3a6b-4594-ac67-b34f89cdb533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:30.537478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1091/2189] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:30.538945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dac61f-396d-4f32-ac06-482aed43568a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:30.551306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dac61f-396d-4f32-ac06-482aed43568a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:30.555222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:30.556836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.557391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.557963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.559246 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:02:30.560177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:30.562750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:30.584826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1099/2190] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:02:30.586534 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d30e5-3a6b-4594-ac67-b34f89cdb533 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:30.600104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d30e5-3a6b-4594-ac67-b34f89cdb533 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:30.607231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aa4b4-403a-4958-813f-586e920a7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:30.608006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aa4b4-403a-4958-813f-586e920a7248 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.608361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aa4b4-403a-4958-813f-586e920a7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.608715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aa4b4-403a-4958-813f-586e920a7248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.609493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aa4b4-403a-4958-813f-586e920a7248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:30.611746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aa4b4-403a-4958-813f-586e920a7248 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:30.625710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:30.658548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1092/2191] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:02:30 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:30.660495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:30.671322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eea0f4-6d2c-4a23-99b6-4e653f8167e8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:30.733809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf48d6e-dc3c-4b6f-8c72-d5194adcc540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:30.734504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48d6e-dc3c-4b6f-8c72-d5194adcc540 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.734795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48d6e-dc3c-4b6f-8c72-d5194adcc540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.735078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48d6e-dc3c-4b6f-8c72-d5194adcc540 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.735782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf48d6e-dc3c-4b6f-8c72-d5194adcc540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:30.738195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf48d6e-dc3c-4b6f-8c72-d5194adcc540 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:30.765000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1100/2192] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:02:30 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:02:30.769991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aa4b4-403a-4958-813f-586e920a7248 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:30.787119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aa4b4-403a-4958-813f-586e920a7248 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:30.792380 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843b50d-e5e8-4da6-bb6f-b98111273c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:30.793094 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b50d-e5e8-4da6-bb6f-b98111273c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.793382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b50d-e5e8-4da6-bb6f-b98111273c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.793714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b50d-e5e8-4da6-bb6f-b98111273c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.794482 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843b50d-e5e8-4da6-bb6f-b98111273c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:30.796160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843b50d-e5e8-4da6-bb6f-b98111273c0a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:30.814144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1093/2193] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:02:30.819314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf48d6e-dc3c-4b6f-8c72-d5194adcc540 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:30.833481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf48d6e-dc3c-4b6f-8c72-d5194adcc540 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:30.839224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105044af-9233-4620-8570-89cf16509390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:30.839952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105044af-9233-4620-8570-89cf16509390 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.840398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105044af-9233-4620-8570-89cf16509390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.840652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105044af-9233-4620-8570-89cf16509390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.841435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105044af-9233-4620-8570-89cf16509390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:30.843157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105044af-9233-4620-8570-89cf16509390 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:30.856777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1101/2194] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:02:30.861017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843b50d-e5e8-4da6-bb6f-b98111273c0a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:30.872480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843b50d-e5e8-4da6-bb6f-b98111273c0a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:30.878113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:30.879222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.879608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.879975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] PATH_INFO: `/v3/projects/f68e44eae2f2494698537b79d4cddad7/users/1d512fa8d25f459897a484a8a6596d00/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:30.897293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68e44eae2f2494698537b79d4cddad7, user_id=1d512fa8d25f459897a484a8a6596d00, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:30.900195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:30.914784 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1094/2195] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:02:30 2022] PUT /identity/v3/projects/f68e44eae2f2494698537b79d4cddad7/users/1d512fa8d25f459897a484a8a6596d00/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:30.987157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ec76-a4e1-4d55-8d01-3211c257a8f0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:30.988035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ec76-a4e1-4d55-8d01-3211c257a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:30.988260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ec76-a4e1-4d55-8d01-3211c257a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:31.023452 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0939ec76-a4e1-4d55-8d01-3211c257a8f0 None None] MFA Rules not processed for user `1d512fa8d25f459897a484a8a6596d00`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:31.024117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0939ec76-a4e1-4d55-8d01-3211c257a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:31.077431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:31.108069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1102/2196] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:31.120962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:31.122731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:31.206268 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b3d50-489f-4e98-95e9-2ee89a6d87af admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:31.212831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e9c71-ac3b-4d57-852e-93ac86fb1b1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:31.213901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e9c71-ac3b-4d57-852e-93ac86fb1b1e service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:31.214472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e9c71-ac3b-4d57-852e-93ac86fb1b1e service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:31.214914 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e9c71-ac3b-4d57-852e-93ac86fb1b1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:31.228492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e9c71-ac3b-4d57-852e-93ac86fb1b1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:31.230120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e9c71-ac3b-4d57-852e-93ac86fb1b1e service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:31.241656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1095/2197] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:41.104967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:41.235468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:48.338259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ec76-a4e1-4d55-8d01-3211c257a8f0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:48.339716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0939ec76-a4e1-4d55-8d01-3211c257a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:48.414582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ec76-a4e1-4d55-8d01-3211c257a8f0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:48.419257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:48.420170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:48.420460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:48.420741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] PATH_INFO: `/v3/users/e6a0a886879746eab48090496801c641` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:48.421976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a0a886879746eab48090496801c641)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:48.424477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:48.489773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a0a886879746eab48090496801c641'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:48.490465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a0a886879746eab48090496801c641'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:48.504848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a0a886879746eab48090496801c641'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:48.515004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a0a886879746eab48090496801c641'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:48.515678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a0a886879746eab48090496801c641'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:48.534098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1103/2198] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:02:48 2022] DELETE /identity/v3/users/e6a0a886879746eab48090496801c641 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:48.544002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c5bd2-12c3-4f76-9f1b-2d80cc3f486a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:48.544568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c5bd2-12c3-4f76-9f1b-2d80cc3f486a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:48.544568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c5bd2-12c3-4f76-9f1b-2d80cc3f486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:48.563789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ca5c5bd2-12c3-4f76-9f1b-2d80cc3f486a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:02:48.565784 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca5c5bd2-12c3-4f76-9f1b-2d80cc3f486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:48.633098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1096/2199] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:02:48.643294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:48.644747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:48.708530 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602e8e-014d-487e-bcdf-b26c22f60376 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:48.712605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:48.713279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:48.713591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:48.713879 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:48.724459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:48.725946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:48.735752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1104/2200] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:49.025435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c5bd2-12c3-4f76-9f1b-2d80cc3f486a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:49.027040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca5c5bd2-12c3-4f76-9f1b-2d80cc3f486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:49.045140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c5bd2-12c3-4f76-9f1b-2d80cc3f486a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:49.050746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:49.051637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:49.051929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:49.052217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] PATH_INFO: `/v3/projects/c0be836228cf4684abf00789cddeb8a3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:49.053439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0be836228cf4684abf00789cddeb8a3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:49.055449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:49.124004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0be836228cf4684abf00789cddeb8a3', 'request_id': 'req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:49.132537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0be836228cf4684abf00789cddeb8a3', 'request_id': 'req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:49.138709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0be836228cf4684abf00789cddeb8a3', 'request_id': 'req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:49.156592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] The token cache is being invalidate because project c0be836228cf4684abf00789cddeb8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:02:49.157609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:49.158335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:02:49.160556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1097/2201] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:02:49 2022] DELETE /identity/v3/projects/c0be836228cf4684abf00789cddeb8a3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:02:50.113338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:02:50.114796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:50.141997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:02:50.215908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f24e3-da46-4998-a764-a1021cf55c9d service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:02:50.277440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cabb46-d7c3-4a2b-a2f4-bf77c42e00b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:02:50.278132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cabb46-d7c3-4a2b-a2f4-bf77c42e00b1 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:02:50.278424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cabb46-d7c3-4a2b-a2f4-bf77c42e00b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:02:50.278704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cabb46-d7c3-4a2b-a2f4-bf77c42e00b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:02:50.280519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d7cabb46-d7c3-4a2b-a2f4-bf77c42e00b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:02:50.293908 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cabb46-d7c3-4a2b-a2f4-bf77c42e00b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:02:50.295507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cabb46-d7c3-4a2b-a2f4-bf77c42e00b1 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:02:50.307518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1105/2202] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:02:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:02:59.153401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:03:00.302936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=57 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:03:19.486428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:19.487870 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:19.552831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae7fd-5a02-4fe2-a61a-87477ddb4ab8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:19.557596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:19.558479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:19.558772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:19.559073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] PATH_INFO: `/v3/users/1d512fa8d25f459897a484a8a6596d00` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:19.560265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d512fa8d25f459897a484a8a6596d00)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:19.562240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:19.614388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d512fa8d25f459897a484a8a6596d00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:19.615047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d512fa8d25f459897a484a8a6596d00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:19.622586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d512fa8d25f459897a484a8a6596d00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:19.635399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d512fa8d25f459897a484a8a6596d00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:19.642279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d512fa8d25f459897a484a8a6596d00'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:19.648487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1098/2203] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:03:19 2022] DELETE /identity/v3/users/1d512fa8d25f459897a484a8a6596d00 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:03:19.653025 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1be788-895f-406c-a320-e60a222900f4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:19.653494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1be788-895f-406c-a320-e60a222900f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:19.653745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1be788-895f-406c-a320-e60a222900f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:19.670636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7c1be788-895f-406c-a320-e60a222900f4 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:03:19.671769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7c1be788-895f-406c-a320-e60a222900f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:19.730462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1106/2204] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:03:19.741403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:19.743123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:19.800371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911447d0-aab3-42ba-9a8e-9ffcd753e9ab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:19.804122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b539ecb-a7ba-4b81-91d8-0e94ba47258b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:19.804769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b539ecb-a7ba-4b81-91d8-0e94ba47258b service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:19.805057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b539ecb-a7ba-4b81-91d8-0e94ba47258b service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:19.805339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b539ecb-a7ba-4b81-91d8-0e94ba47258b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:19.815148 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b539ecb-a7ba-4b81-91d8-0e94ba47258b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:19.816578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b539ecb-a7ba-4b81-91d8-0e94ba47258b service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:19.825946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1099/2205] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:03:20.097636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1be788-895f-406c-a320-e60a222900f4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:20.099212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7c1be788-895f-406c-a320-e60a222900f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:20.111941 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1be788-895f-406c-a320-e60a222900f4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:20.116785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:20.117716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.118253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.118529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] PATH_INFO: `/v3/projects/f68e44eae2f2494698537b79d4cddad7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.119724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68e44eae2f2494698537b79d4cddad7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:20.121704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:20.170656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68e44eae2f2494698537b79d4cddad7', 'request_id': 'req-f12ae537-d67f-4e4d-a209-535ce539e82b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:20.177594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68e44eae2f2494698537b79d4cddad7', 'request_id': 'req-f12ae537-d67f-4e4d-a209-535ce539e82b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:20.185235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68e44eae2f2494698537b79d4cddad7', 'request_id': 'req-f12ae537-d67f-4e4d-a209-535ce539e82b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:20.195368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] The token cache is being invalidate because project f68e44eae2f2494698537b79d4cddad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:03:20.195653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:20.196281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f12ae537-d67f-4e4d-a209-535ce539e82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:03:20.197847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1107/2206] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:03:20 2022] DELETE /identity/v3/projects/f68e44eae2f2494698537b79d4cddad7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:03:20.202836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26fc39-83a8-463c-bc13-5ab34323628d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.203130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26fc39-83a8-463c-bc13-5ab34323628d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.203416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26fc39-83a8-463c-bc13-5ab34323628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.222171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0c26fc39-83a8-463c-bc13-5ab34323628d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:03:20.223378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c26fc39-83a8-463c-bc13-5ab34323628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:20.242308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:03:20.290176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1100/2207] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:03:20.298134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6934f-31f4-4da5-8901-36376c471e05 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.298381 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6934f-31f4-4da5-8901-36376c471e05 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.298642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6934f-31f4-4da5-8901-36376c471e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.316709 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-93b6934f-31f4-4da5-8901-36376c471e05 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:03:20.317951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-93b6934f-31f4-4da5-8901-36376c471e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:20.325776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1108/2208] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:03:20.330777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26fc39-83a8-463c-bc13-5ab34323628d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:20.340501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26fc39-83a8-463c-bc13-5ab34323628d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:20.346088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:20.346749 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.347037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.347319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.348047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:03:20.348361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:20.350005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:20.361825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1101/2209] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:03:20.366164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6934f-31f4-4da5-8901-36376c471e05 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:20.375829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6934f-31f4-4da5-8901-36376c471e05 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:20.380431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8806c-cefb-4477-a5fa-266989d01c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:20.381079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8806c-cefb-4477-a5fa-266989d01c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.381363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8806c-cefb-4477-a5fa-266989d01c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.381682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8806c-cefb-4477-a5fa-266989d01c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.382382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8806c-cefb-4477-a5fa-266989d01c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:20.384277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8806c-cefb-4477-a5fa-266989d01c26 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:20.411645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1109/2210] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:03:20 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:03:20.416050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:20.429698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa05b7-20db-495f-8300-91b7a6a9f9cc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:20.489827 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf216a49-2b8c-4809-895a-03a4830ff8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:20.490568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a49-2b8c-4809-895a-03a4830ff8fc admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.490897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a49-2b8c-4809-895a-03a4830ff8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.491187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a49-2b8c-4809-895a-03a4830ff8fc admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.491985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf216a49-2b8c-4809-895a-03a4830ff8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:20.494444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf216a49-2b8c-4809-895a-03a4830ff8fc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:20.518538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1102/2211] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:03:20 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:03:20.519676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8806c-cefb-4477-a5fa-266989d01c26 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:20.530576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8806c-cefb-4477-a5fa-266989d01c26 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:20.536091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800593e5-390a-47e6-b3c9-b5dfeb7579f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:20.536789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800593e5-390a-47e6-b3c9-b5dfeb7579f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.537120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800593e5-390a-47e6-b3c9-b5dfeb7579f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.537443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800593e5-390a-47e6-b3c9-b5dfeb7579f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.538243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800593e5-390a-47e6-b3c9-b5dfeb7579f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:20.539967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800593e5-390a-47e6-b3c9-b5dfeb7579f7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:20.550945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1110/2212] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:03:20.555060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf216a49-2b8c-4809-895a-03a4830ff8fc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:20.566009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf216a49-2b8c-4809-895a-03a4830ff8fc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:20.570631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319ecf-e991-4684-829d-799affcf3f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:20.571309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319ecf-e991-4684-829d-799affcf3f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.571590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319ecf-e991-4684-829d-799affcf3f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.572038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319ecf-e991-4684-829d-799affcf3f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.572828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2319ecf-e991-4684-829d-799affcf3f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:20.574464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2319ecf-e991-4684-829d-799affcf3f4e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:20.585333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1103/2213] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:03:20.589663 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800593e5-390a-47e6-b3c9-b5dfeb7579f7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:20.599727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800593e5-390a-47e6-b3c9-b5dfeb7579f7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:20.604300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:20.605176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.605460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.605766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] PATH_INFO: `/v3/projects/105ce6e57b994084adb8380b639741f6/users/3de563cdf9154ce6af641b2a52db0182/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.622764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105ce6e57b994084adb8380b639741f6, user_id=3de563cdf9154ce6af641b2a52db0182, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:20.626302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:20.645034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1111/2214] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:03:20 2022] PUT /identity/v3/projects/105ce6e57b994084adb8380b639741f6/users/3de563cdf9154ce6af641b2a52db0182/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:03:20.650520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57c202-f671-4580-b3d0-a527c68a1bf6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.650930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57c202-f671-4580-b3d0-a527c68a1bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.651261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57c202-f671-4580-b3d0-a527c68a1bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.669506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-af57c202-f671-4580-b3d0-a527c68a1bf6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:03:20.670732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af57c202-f671-4580-b3d0-a527c68a1bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:20.730439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1104/2215] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:03:20.739962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:20.741773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:20.763710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:03:20.802645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48039d7-2fa5-42c0-bd4e-0ab20fee99f5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:20.806275 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:20.806922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:20.807206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:20.807483 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:20.816997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:20.818722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:20.828334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1112/2216] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:03:21.487732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837946c-f1b9-4491-94c9-321f933d4efd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:21.488033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837946c-f1b9-4491-94c9-321f933d4efd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:21.488321 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837946c-f1b9-4491-94c9-321f933d4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:21.517805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f837946c-f1b9-4491-94c9-321f933d4efd None None] MFA Rules not processed for user `3de563cdf9154ce6af641b2a52db0182`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:03:21.519041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f837946c-f1b9-4491-94c9-321f933d4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:21.536503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:03:21.587361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1105/2217] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:03:21.600072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:21.601857 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:21.664323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cc53-712a-4e45-aded-b15af74291a2 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:21.667891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197730a-d220-4f05-924f-acf633d9f25a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:21.668557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197730a-d220-4f05-924f-acf633d9f25a service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:21.668849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197730a-d220-4f05-924f-acf633d9f25a service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:21.669135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197730a-d220-4f05-924f-acf633d9f25a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:21.679244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197730a-d220-4f05-924f-acf633d9f25a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:21.680856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197730a-d220-4f05-924f-acf633d9f25a service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:21.690587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1113/2218] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:03:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:03:23.041328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77be1-109a-4c5c-b7b7-9a03f5d016a4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:23.041898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77be1-109a-4c5c-b7b7-9a03f5d016a4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:23.041989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77be1-109a-4c5c-b7b7-9a03f5d016a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:23.060428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a3d77be1-109a-4c5c-b7b7-9a03f5d016a4 None None] MFA Rules not processed for user `3de563cdf9154ce6af641b2a52db0182`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:03:23.061688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a3d77be1-109a-4c5c-b7b7-9a03f5d016a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:23.070111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1106/2219] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:03:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:03:31.686065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=43 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:03:33.054821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=22 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:03:42.849826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fac871-76d4-4364-aa48-aac82b763790 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:42.850383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fac871-76d4-4364-aa48-aac82b763790 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:42.850383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fac871-76d4-4364-aa48-aac82b763790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:42.870550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-40fac871-76d4-4364-aa48-aac82b763790 None None] MFA Rules not processed for user `dcd4aeea3a094122a7c7c6944b96cb71`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:03:42.872194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-40fac871-76d4-4364-aa48-aac82b763790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:42.943789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1114/2220] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:03:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:03:52.931537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=25 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:03:57.254873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897cb6-02f0-468d-b7b0-20504c7accc7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:57.255460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897cb6-02f0-468d-b7b0-20504c7accc7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:57.255460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897cb6-02f0-468d-b7b0-20504c7accc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:57.323625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-64897cb6-02f0-468d-b7b0-20504c7accc7 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:03:57.325292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64897cb6-02f0-468d-b7b0-20504c7accc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:57.398492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1107/2221] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:03:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:03:57.439518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fac871-76d4-4364-aa48-aac82b763790 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:03:57.441023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-40fac871-76d4-4364-aa48-aac82b763790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:03:57.534530 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fac871-76d4-4364-aa48-aac82b763790 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:03:57.539727 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef411503-0e4c-4364-b645-40c0cb6d2f60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:03:57.540434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef411503-0e4c-4364-b645-40c0cb6d2f60 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:03:57.540724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef411503-0e4c-4364-b645-40c0cb6d2f60 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:03:57.541009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef411503-0e4c-4364-b645-40c0cb6d2f60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:03:57.550288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef411503-0e4c-4364-b645-40c0cb6d2f60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:03:57.551859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef411503-0e4c-4364-b645-40c0cb6d2f60 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:03:57.560022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1115/2222] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:03:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:04:07.395637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=47 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:04:07.556813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=41 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:04:15.056478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad22bf-1e45-48a1-aa1c-c140cb44056b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.057681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad22bf-1e45-48a1-aa1c-c140cb44056b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.058129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad22bf-1e45-48a1-aa1c-c140cb44056b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.059840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1108/2223] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:04:15.067579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d31670-02f1-48c9-910d-83aa6a10d858 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.068683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d31670-02f1-48c9-910d-83aa6a10d858 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.069172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d31670-02f1-48c9-910d-83aa6a10d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.132086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-78d31670-02f1-48c9-910d-83aa6a10d858 None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:04:15.133499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-78d31670-02f1-48c9-910d-83aa6a10d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:04:15.262786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1116/2224] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:04:15.275980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad22bf-1e45-48a1-aa1c-c140cb44056b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:04:15.277976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5fad22bf-1e45-48a1-aa1c-c140cb44056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:04:15.368466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad22bf-1e45-48a1-aa1c-c140cb44056b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:04:15.372568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468fe85-64ca-4d8c-a31c-d5a47f3c1458 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:04:15.373920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468fe85-64ca-4d8c-a31c-d5a47f3c1458 service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.373920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468fe85-64ca-4d8c-a31c-d5a47f3c1458 service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.373920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468fe85-64ca-4d8c-a31c-d5a47f3c1458 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.386131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468fe85-64ca-4d8c-a31c-d5a47f3c1458 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:04:15.387814 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468fe85-64ca-4d8c-a31c-d5a47f3c1458 service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:04:15.406855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1109/2225] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:04:15.481359 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65075-5639-4c83-a7d4-d1599957fb77 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.481688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65075-5639-4c83-a7d4-d1599957fb77 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.481975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65075-5639-4c83-a7d4-d1599957fb77 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.483396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1117/2226] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:04:15.488399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a197-8e4c-4ae5-9696-a8f0b24f49b3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.488739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a197-8e4c-4ae5-9696-a8f0b24f49b3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.488981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a197-8e4c-4ae5-9696-a8f0b24f49b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.508840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1635a197-8e4c-4ae5-9696-a8f0b24f49b3 None None] MFA Rules not processed for user `98d7ac35d0e846af97f3ca345ec2ac09`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:04:15.510093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1635a197-8e4c-4ae5-9696-a8f0b24f49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:04:15.527220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1110/2227] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:04:15.539706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf65075-5639-4c83-a7d4-d1599957fb77 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:04:15.541473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6cf65075-5639-4c83-a7d4-d1599957fb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:04:15.555608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf65075-5639-4c83-a7d4-d1599957fb77 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:04:15.559224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a061d8-8d48-4d18-ab34-557bc47690e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:04:15.559896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a061d8-8d48-4d18-ab34-557bc47690e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.560189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a061d8-8d48-4d18-ab34-557bc47690e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.560540 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a061d8-8d48-4d18-ab34-557bc47690e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.568940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a061d8-8d48-4d18-ab34-557bc47690e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:04:15.575967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a061d8-8d48-4d18-ab34-557bc47690e7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:04:15.580827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1118/2228] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:04:15.694805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75849fe-b9d7-4e35-95f8-088cb69ed586 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.695240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75849fe-b9d7-4e35-95f8-088cb69ed586 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.695828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75849fe-b9d7-4e35-95f8-088cb69ed586 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.697230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1111/2229] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:04:15.704174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ba8d-439a-4171-b170-f3f5d826d0f5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.704682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ba8d-439a-4171-b170-f3f5d826d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.705092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ba8d-439a-4171-b170-f3f5d826d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.726345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c495ba8d-439a-4171-b170-f3f5d826d0f5 None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:04:15.727694 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c495ba8d-439a-4171-b170-f3f5d826d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:04:15.745283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1119/2230] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:04:15.756705 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75849fe-b9d7-4e35-95f8-088cb69ed586 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:04:15.771361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75849fe-b9d7-4e35-95f8-088cb69ed586 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:04:15.775350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122af861-c03b-49a9-a476-4ac04643392b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:04:15.776783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122af861-c03b-49a9-a476-4ac04643392b service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:15.776783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122af861-c03b-49a9-a476-4ac04643392b service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:15.776783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122af861-c03b-49a9-a476-4ac04643392b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:15.789928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122af861-c03b-49a9-a476-4ac04643392b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:04:15.791455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122af861-c03b-49a9-a476-4ac04643392b service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:04:15.806487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1112/2231] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:04:25.720455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=55 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:04:25.798715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=44 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:04:26.612661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19486-93ae-4420-8e38-b0ec438205c2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:26.612956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19486-93ae-4420-8e38-b0ec438205c2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:26.613245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19486-93ae-4420-8e38-b0ec438205c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:26.631917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d6f19486-93ae-4420-8e38-b0ec438205c2 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:04:26.633118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d6f19486-93ae-4420-8e38-b0ec438205c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:04:26.640417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1120/2232] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:04:26.652025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122af861-c03b-49a9-a476-4ac04643392b service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:04:26.663762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122af861-c03b-49a9-a476-4ac04643392b service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:04:26.668712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060c405-0814-4d59-9b62-ebff93c38317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:04:26.669347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c405-0814-4d59-9b62-ebff93c38317 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:26.670308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c405-0814-4d59-9b62-ebff93c38317 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:26.670594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c405-0814-4d59-9b62-ebff93c38317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:26.678839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060c405-0814-4d59-9b62-ebff93c38317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:04:26.680434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060c405-0814-4d59-9b62-ebff93c38317 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:04:26.688764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1113/2233] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:04:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:04:36.626583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:04:36.685967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:04:44.150795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f19486-93ae-4420-8e38-b0ec438205c2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:04:44.160831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f19486-93ae-4420-8e38-b0ec438205c2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:04:44.164703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:04:44.165352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:44.165668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:44.165951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:44.167797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:04:44.182162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:04:44.183599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:04:44.196014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1121/2234] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:04:44.893797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060c405-0814-4d59-9b62-ebff93c38317 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:04:44.904027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060c405-0814-4d59-9b62-ebff93c38317 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:04:44.907989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:04:44.908635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:04:44.908925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:04:44.909207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:04:44.911173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:04:44.925118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:04:44.926592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:04:44.937649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1114/2235] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:04:54.190646 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:04:54.932668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:05:00.885787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:05:00.888220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:00.905522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cc71-6076-4179-8c59-d7ba37359060 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:05:00.912659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:05:00.913456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:00.913880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:00.914263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:00.916637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:00.996613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:05:00.998326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:05:01.008232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1122/2236] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:05:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:05:01.498281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:05:01.515725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81c37c-d7ae-4786-9d55-4d493c2c72e5 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:05:01.521869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7336b6-3549-439a-9bee-64924455c5a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:05:01.523024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7336b6-3549-439a-9bee-64924455c5a5 service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:01.523526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7336b6-3549-439a-9bee-64924455c5a5 service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:01.524030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7336b6-3549-439a-9bee-64924455c5a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:01.527067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eb7336b6-3549-439a-9bee-64924455c5a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:01.576911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:05:01.578797 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:01.611168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7336b6-3549-439a-9bee-64924455c5a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:05:01.612820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7336b6-3549-439a-9bee-64924455c5a5 service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:05:01.615209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd7ccc-ce70-4aea-acd7-0c080c0716f3 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:05:01.626317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1115/2237] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:05:01.641094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:05:01.653582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:01.653582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:01.653582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:01.658653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241bd6-d1dc-41d7-9c90-d0749e1e55f7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:01.659092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241bd6-d1dc-41d7-9c90-d0749e1e55f7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:01.659584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241bd6-d1dc-41d7-9c90-d0749e1e55f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:01.674380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:05:01.682173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:05:01.685494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-64241bd6-d1dc-41d7-9c90-d0749e1e55f7 None None] MFA Rules not processed for user `3de563cdf9154ce6af641b2a52db0182`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:05:01.688045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64241bd6-d1dc-41d7-9c90-d0749e1e55f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:01.694203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1123/2238] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:05:01.695634 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1116/2239] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:05:02.333456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:05:02.334942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:02.440156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954507c-c0ec-4c52-8ec0-e25e1a36bb03 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:05:02.445417 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:05:02.446123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:02.446395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:02.446687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:02.449505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:02.461780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:05:02.463426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:05:02.474461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1124/2240] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:05:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:05:05.043391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234075aa-5394-4307-87b5-3b6438192d73 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:05.043984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234075aa-5394-4307-87b5-3b6438192d73 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:05.044483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234075aa-5394-4307-87b5-3b6438192d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:05.065971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-234075aa-5394-4307-87b5-3b6438192d73 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:05:05.067286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-234075aa-5394-4307-87b5-3b6438192d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:05.076397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1117/2241] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 8 13:05:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:05:05.101685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:05:05.116241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0e576-6ab4-4bcf-bf7f-5371141bd828 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:05:05.122682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfdca1-c316-46d9-8701-ffe5f471d448 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:05:05.123380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfdca1-c316-46d9-8701-ffe5f471d448 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:05.123666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfdca1-c316-46d9-8701-ffe5f471d448 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:05.123946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfdca1-c316-46d9-8701-ffe5f471d448 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:05.133320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfdca1-c316-46d9-8701-ffe5f471d448 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:05:05.136027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfdca1-c316-46d9-8701-ffe5f471d448 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:05:05.136176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234075aa-5394-4307-87b5-3b6438192d73 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:05:05.145235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1125/2242] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:05:05.146275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234075aa-5394-4307-87b5-3b6438192d73 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:05:05.150047 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:05:05.150746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:05.150988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:05.151308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:05.153931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:05.165597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:05:05.167079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:05:05.177379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1118/2243] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:05:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:05:15.141532 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=72 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:05:15.173577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=40 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:05:23.215293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba539-1cf5-4061-9cf9-3d5c4abac24e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:23.217068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba539-1cf5-4061-9cf9-3d5c4abac24e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:23.217068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba539-1cf5-4061-9cf9-3d5c4abac24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:23.237039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-456ba539-1cf5-4061-9cf9-3d5c4abac24e None None] MFA Rules not processed for user `2a550d483fee4f84a11dccf72fc85dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:05:23.238313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-456ba539-1cf5-4061-9cf9-3d5c4abac24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:23.247637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1126/2244] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:05:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:05:33.230433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:05:37.738750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:05:37.752237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac7546-0d10-42b0-b34f-12466a163c53 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:05:37.757989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:05:37.758726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:05:37.759084 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:05:37.759435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:05:37.761356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:05:37.774807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:05:37.776539 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:05:37.789155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1119/2245] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:05:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:05:47.784413 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:06:01.103807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ba539-1cf5-4061-9cf9-3d5c4abac24e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:06:01.117577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ba539-1cf5-4061-9cf9-3d5c4abac24e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:06:01.125134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:06:01.125835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:01.126126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:01.126414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:01.128266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:01.192547 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:06:01.194223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:06:01.203589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1127/2246] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:06:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:06:10.340771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:06:10.351936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0612c1a-f4a1-45c5-b004-970daddc91d0 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:06:10.356781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:06:10.357662 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:10.357957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:10.358245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] PATH_INFO: `/v3/users/3de563cdf9154ce6af641b2a52db0182` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:10.359492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de563cdf9154ce6af641b2a52db0182)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:06:10.361431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:06:10.410155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de563cdf9154ce6af641b2a52db0182'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.410900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de563cdf9154ce6af641b2a52db0182'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.418846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de563cdf9154ce6af641b2a52db0182'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.431389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de563cdf9154ce6af641b2a52db0182'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.438705 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de563cdf9154ce6af641b2a52db0182'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.446231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1120/2247] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:06:10 2022] DELETE /identity/v3/users/3de563cdf9154ce6af641b2a52db0182 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:06:10.659661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:06:10.672541 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f92c5-f746-4655-bf1f-ed9f4165cd8c service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:06:10.735063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:06:10.735848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:10.736136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:10.736414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] PATH_INFO: `/v3/projects/105ce6e57b994084adb8380b639741f6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:10.737649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105ce6e57b994084adb8380b639741f6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:06:10.739565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:06:10.789775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105ce6e57b994084adb8380b639741f6', 'request_id': 'req-23669dcb-49fd-425c-96de-187b6f6af4d4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.797137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105ce6e57b994084adb8380b639741f6', 'request_id': 'req-23669dcb-49fd-425c-96de-187b6f6af4d4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.805270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105ce6e57b994084adb8380b639741f6', 'request_id': 'req-23669dcb-49fd-425c-96de-187b6f6af4d4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.817255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] The token cache is being invalidate because project 105ce6e57b994084adb8380b639741f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:06:10.818323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.818852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23669dcb-49fd-425c-96de-187b6f6af4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:06:10.821648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1128/2248] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:06:10 2022] DELETE /identity/v3/projects/105ce6e57b994084adb8380b639741f6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:06:15.607291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:06:15.608758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:15.683132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd098fe-87bc-4d76-8ed7-d061ae6e3cc5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:06:15.746756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:06:15.747415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:15.747706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:15.747994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:15.749808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:15.755934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:06:15.814286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:06:15.815802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:06:15.827008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1121/2249] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:06:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:06:20.814263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:06:25.821682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=24 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:06:28.240832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1bb20-9133-491e-ba9f-1cea367f416c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:28.241369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1bb20-9133-491e-ba9f-1cea367f416c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:28.241473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1bb20-9133-491e-ba9f-1cea367f416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:28.260942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-25a1bb20-9133-491e-ba9f-1cea367f416c None None] MFA Rules not processed for user `dcd4aeea3a094122a7c7c6944b96cb71`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:06:28.263009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-25a1bb20-9133-491e-ba9f-1cea367f416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:28.270001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1129/2250] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:06:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:06:28.582085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:06:28.583548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:28.646058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849fba8-c933-4352-97b0-350d8b07399d service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:06:28.651344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:06:28.652700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:28.653366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:28.653967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:28.656687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:28.669753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:06:28.671323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:06:28.680163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1122/2251] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:06:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:06:33.357469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efd1d-6f2b-4d91-af2c-3a47ae2dd0ec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:33.358033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efd1d-6f2b-4d91-af2c-3a47ae2dd0ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:33.358139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efd1d-6f2b-4d91-af2c-3a47ae2dd0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:33.376666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-839efd1d-6f2b-4d91-af2c-3a47ae2dd0ec None None] MFA Rules not processed for user `8986cbf0b3534177a6436113896b161d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:06:33.377944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-839efd1d-6f2b-4d91-af2c-3a47ae2dd0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:33.441155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1130/2252] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:06:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:06:37.155357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:06:37.156835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:37.181935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd1dfe-c807-4602-b222-a4fec5d14dea service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:06:37.188192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:06:37.188961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:37.189317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:37.189712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:37.191609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:37.205013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:06:37.206800 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:06:37.218626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1123/2253] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:06:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:06:42.003190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839efd1d-6f2b-4d91-af2c-3a47ae2dd0ec None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:06:42.019327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839efd1d-6f2b-4d91-af2c-3a47ae2dd0ec None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:06:42.026873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a49ad-96c0-45e3-bc3e-3d0a9f4a622e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:06:42.028113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a49ad-96c0-45e3-bc3e-3d0a9f4a622e service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:06:42.028113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a49ad-96c0-45e3-bc3e-3d0a9f4a622e service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:06:42.028113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a49ad-96c0-45e3-bc3e-3d0a9f4a622e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:06:42.033593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-243a49ad-96c0-45e3-bc3e-3d0a9f4a622e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:06:42.043464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a49ad-96c0-45e3-bc3e-3d0a9f4a622e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:06:42.045235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a49ad-96c0-45e3-bc3e-3d0a9f4a622e service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:06:42.058818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1131/2254] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:06:47.214294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=32 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:06:52.051968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=34 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:00.954027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:00.955455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:00.967198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ed59c-acf0-4ff7-afe0-551c6935a2ca service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:00.970840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df656ce4-f939-4fb0-8d42-75d2e2ae73fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:00.971489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656ce4-f939-4fb0-8d42-75d2e2ae73fb service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:00.971777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656ce4-f939-4fb0-8d42-75d2e2ae73fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:00.972059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656ce4-f939-4fb0-8d42-75d2e2ae73fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:00.973904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-df656ce4-f939-4fb0-8d42-75d2e2ae73fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:01.037351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df656ce4-f939-4fb0-8d42-75d2e2ae73fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:01.038841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df656ce4-f939-4fb0-8d42-75d2e2ae73fb service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:01.049342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1124/2255] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:04.335853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c690-5cd8-49c0-a74c-c3444b253544 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:04.336422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c690-5cd8-49c0-a74c-c3444b253544 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:04.336513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c690-5cd8-49c0-a74c-c3444b253544 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:04.338685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1132/2256] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:07:04.350451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944cc1e-2b42-40a2-bc0a-6b78cb68184d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:04.350451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944cc1e-2b42-40a2-bc0a-6b78cb68184d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:04.350451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944cc1e-2b42-40a2-bc0a-6b78cb68184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:04.402057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e944cc1e-2b42-40a2-bc0a-6b78cb68184d None None] MFA Rules not processed for user `a6bc294afca749e5bc2d44c65ea7f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:04.403925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e944cc1e-2b42-40a2-bc0a-6b78cb68184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:04.441356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3c690-5cd8-49c0-a74c-c3444b253544 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:04.443195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b1c3c690-5cd8-49c0-a74c-c3444b253544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:04.459851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3c690-5cd8-49c0-a74c-c3444b253544 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:04.465220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:04.466147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:04.466485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:04.466794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] PATH_INFO: `/v3/users/2a550d483fee4f84a11dccf72fc85dd6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:04.468014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a550d483fee4f84a11dccf72fc85dd6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:04.470253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:04.491613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1125/2257] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:07:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:04.506389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944cc1e-2b42-40a2-bc0a-6b78cb68184d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:04.508084 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e944cc1e-2b42-40a2-bc0a-6b78cb68184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:04.522474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944cc1e-2b42-40a2-bc0a-6b78cb68184d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:04.526084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a550d483fee4f84a11dccf72fc85dd6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.526769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a550d483fee4f84a11dccf72fc85dd6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.529617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18cd23-3847-40a6-b906-f51e76178aed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:04.530410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18cd23-3847-40a6-b906-f51e76178aed service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:04.530705 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18cd23-3847-40a6-b906-f51e76178aed service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:04.530993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18cd23-3847-40a6-b906-f51e76178aed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:04.533881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a550d483fee4f84a11dccf72fc85dd6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.540001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18cd23-3847-40a6-b906-f51e76178aed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:04.541714 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18cd23-3847-40a6-b906-f51e76178aed service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:04.542021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a550d483fee4f84a11dccf72fc85dd6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.543041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40a7e5d2-5b25-4522-bd51-95666dbf2ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a550d483fee4f84a11dccf72fc85dd6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.555873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1126/2258] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:04.565923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1133/2259] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:04 2022] DELETE /identity/v3/users/2a550d483fee4f84a11dccf72fc85dd6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:07:04.749644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18cd23-3847-40a6-b906-f51e76178aed service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:04.761021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18cd23-3847-40a6-b906-f51e76178aed service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:04.832117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:04.833006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:04.833296 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:04.833614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] PATH_INFO: `/v3/projects/2d72d1cf271f460e80d13a6678c36d71` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:04.834846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d72d1cf271f460e80d13a6678c36d71)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:04.836776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:04.844318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:04.890247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d72d1cf271f460e80d13a6678c36d71', 'request_id': 'req-91e274af-5038-4b98-ac8d-cac72f8984cd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.898721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d72d1cf271f460e80d13a6678c36d71', 'request_id': 'req-91e274af-5038-4b98-ac8d-cac72f8984cd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.905355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d72d1cf271f460e80d13a6678c36d71', 'request_id': 'req-91e274af-5038-4b98-ac8d-cac72f8984cd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.917236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] The token cache is being invalidate because project 2d72d1cf271f460e80d13a6678c36d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:04.917532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.918221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-91e274af-5038-4b98-ac8d-cac72f8984cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:04.919849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1127/2260] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:04 2022] DELETE /identity/v3/projects/2d72d1cf271f460e80d13a6678c36d71 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:04.924851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca91b3-ecd9-4b49-a1f0-0e3eece25c97 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:04.925147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca91b3-ecd9-4b49-a1f0-0e3eece25c97 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:04.925436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca91b3-ecd9-4b49-a1f0-0e3eece25c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:04.942922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-beca91b3-ecd9-4b49-a1f0-0e3eece25c97 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:04.944149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-beca91b3-ecd9-4b49-a1f0-0e3eece25c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:05.005833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1134/2261] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:05.014406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ef75-a859-40e1-b397-755b5772618d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.014704 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ef75-a859-40e1-b397-755b5772618d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.014992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ef75-a859-40e1-b397-755b5772618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.033830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4176ef75-a859-40e1-b397-755b5772618d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:05.034965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4176ef75-a859-40e1-b397-755b5772618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:05.042958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1128/2262] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:05.047211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca91b3-ecd9-4b49-a1f0-0e3eece25c97 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.056917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca91b3-ecd9-4b49-a1f0-0e3eece25c97 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.061483 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.062171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.062462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.062745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.063472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:07:05.063783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.065379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.078211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1135/2263] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:07:05.082453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ef75-a859-40e1-b397-755b5772618d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.092004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ef75-a859-40e1-b397-755b5772618d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.096664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd621f-5963-4a40-b3f1-64d55c15e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.097318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd621f-5963-4a40-b3f1-64d55c15e1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.097649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd621f-5963-4a40-b3f1-64d55c15e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.097936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd621f-5963-4a40-b3f1-64d55c15e1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.098631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd621f-5963-4a40-b3f1-64d55c15e1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.100545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd621f-5963-4a40-b3f1-64d55c15e1c0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.136859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1129/2264] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:05 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:05.141086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.151028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee9e0-97e3-41ff-b943-96a07ceacbd3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.215153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbecff-6c9e-437a-bfe1-ee53c215c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.215832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbecff-6c9e-437a-bfe1-ee53c215c305 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.216123 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbecff-6c9e-437a-bfe1-ee53c215c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.216408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbecff-6c9e-437a-bfe1-ee53c215c305 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.217099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbecff-6c9e-437a-bfe1-ee53c215c305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.219067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbecff-6c9e-437a-bfe1-ee53c215c305 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.225715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:05.240447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1136/2265] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:05 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:05.245772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd621f-5963-4a40-b3f1-64d55c15e1c0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.256318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd621f-5963-4a40-b3f1-64d55c15e1c0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.261509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bbb16-4f8d-43b9-82c5-794b9a57a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.262224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bbb16-4f8d-43b9-82c5-794b9a57a0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.262544 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bbb16-4f8d-43b9-82c5-794b9a57a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.262858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bbb16-4f8d-43b9-82c5-794b9a57a0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.263663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bbb16-4f8d-43b9-82c5-794b9a57a0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.265275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bbb16-4f8d-43b9-82c5-794b9a57a0e1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.276149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1130/2266] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:07:05.280217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbecff-6c9e-437a-bfe1-ee53c215c305 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.290226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbecff-6c9e-437a-bfe1-ee53c215c305 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.295484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5464e-882a-4dec-8aa7-51ceca5cb9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.296148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5464e-882a-4dec-8aa7-51ceca5cb9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.296439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5464e-882a-4dec-8aa7-51ceca5cb9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.296723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5464e-882a-4dec-8aa7-51ceca5cb9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.297450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5464e-882a-4dec-8aa7-51ceca5cb9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.299078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5464e-882a-4dec-8aa7-51ceca5cb9d7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.308921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1137/2267] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:05.312993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bbb16-4f8d-43b9-82c5-794b9a57a0e1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.324251 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bbb16-4f8d-43b9-82c5-794b9a57a0e1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.328878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f358e-755d-49ea-8504-df18dd0fb742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.329868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f358e-755d-49ea-8504-df18dd0fb742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.330155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f358e-755d-49ea-8504-df18dd0fb742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.330435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f358e-755d-49ea-8504-df18dd0fb742 admin admin] PATH_INFO: `/v3/projects/955f223ab8a1462aba7e46e0653bf237/users/3618fc5aef3f41538adb4a3c690d61fb/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.346356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f358e-755d-49ea-8504-df18dd0fb742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955f223ab8a1462aba7e46e0653bf237, user_id=3618fc5aef3f41538adb4a3c690d61fb, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.348999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f358e-755d-49ea-8504-df18dd0fb742 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.362533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1131/2268] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:05 2022] PUT /identity/v3/projects/955f223ab8a1462aba7e46e0653bf237/users/3618fc5aef3f41538adb4a3c690d61fb/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:05.373847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a3d1-dc98-462a-824e-8ae646a1cad7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.374317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a3d1-dc98-462a-824e-8ae646a1cad7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.374575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a3d1-dc98-462a-824e-8ae646a1cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.401973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-14a9a3d1-dc98-462a-824e-8ae646a1cad7 None None] MFA Rules not processed for user `3618fc5aef3f41538adb4a3c690d61fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:05.403191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-14a9a3d1-dc98-462a-824e-8ae646a1cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:05.468438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1138/2269] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:05.472990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f358e-755d-49ea-8504-df18dd0fb742 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.536332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f358e-755d-49ea-8504-df18dd0fb742 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.541787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d3a2d-76e5-48bf-9502-2eedab753a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.542378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d3a2d-76e5-48bf-9502-2eedab753a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.542663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d3a2d-76e5-48bf-9502-2eedab753a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.542945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d3a2d-76e5-48bf-9502-2eedab753a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.543643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d3a2d-76e5-48bf-9502-2eedab753a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.545603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d3a2d-76e5-48bf-9502-2eedab753a33 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.571119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1132/2270] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:05 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:05.575195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9a3d1-dc98-462a-824e-8ae646a1cad7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.585934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9a3d1-dc98-462a-824e-8ae646a1cad7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.644791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b21a3-0746-4b38-9f65-4ca4d2ca6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.645469 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b21a3-0746-4b38-9f65-4ca4d2ca6719 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.645786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b21a3-0746-4b38-9f65-4ca4d2ca6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.646073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b21a3-0746-4b38-9f65-4ca4d2ca6719 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.646786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b21a3-0746-4b38-9f65-4ca4d2ca6719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.648755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b21a3-0746-4b38-9f65-4ca4d2ca6719 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.670971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1139/2271] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:05 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:05.674956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d3a2d-76e5-48bf-9502-2eedab753a33 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.685426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d3a2d-76e5-48bf-9502-2eedab753a33 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.690122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb3457-ad4f-4a9d-b827-6fe79b0f0d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.690789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3457-ad4f-4a9d-b827-6fe79b0f0d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.691082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3457-ad4f-4a9d-b827-6fe79b0f0d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.691368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3457-ad4f-4a9d-b827-6fe79b0f0d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.692103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb3457-ad4f-4a9d-b827-6fe79b0f0d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.693750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb3457-ad4f-4a9d-b827-6fe79b0f0d83 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.695049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:05.707101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1133/2272] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:05.711344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b21a3-0746-4b38-9f65-4ca4d2ca6719 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.722279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b21a3-0746-4b38-9f65-4ca4d2ca6719 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.727066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dfbe2-ffb1-478e-9478-b254fbf331df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.727948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dfbe2-ffb1-478e-9478-b254fbf331df admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.728258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dfbe2-ffb1-478e-9478-b254fbf331df admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.728537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dfbe2-ffb1-478e-9478-b254fbf331df admin admin] PATH_INFO: `/v3/projects/866834e5860b405eab75e587aa788a3e/users/edb7fd0db9f54634857e85ae1afe40bc/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.745048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dfbe2-ffb1-478e-9478-b254fbf331df admin admin] RBAC: Authorizing `identity:create_grant(project_id=866834e5860b405eab75e587aa788a3e, user_id=edb7fd0db9f54634857e85ae1afe40bc, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.747836 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dfbe2-ffb1-478e-9478-b254fbf331df admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.761749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1140/2273] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:05 2022] PUT /identity/v3/projects/866834e5860b405eab75e587aa788a3e/users/edb7fd0db9f54634857e85ae1afe40bc/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:05.765748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb3457-ad4f-4a9d-b827-6fe79b0f0d83 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.776469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb3457-ad4f-4a9d-b827-6fe79b0f0d83 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.832594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17338b50-7128-432d-af3d-38df69f4cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.833273 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338b50-7128-432d-af3d-38df69f4cee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.833593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338b50-7128-432d-af3d-38df69f4cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.833885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338b50-7128-432d-af3d-38df69f4cee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.834622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17338b50-7128-432d-af3d-38df69f4cee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.836234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17338b50-7128-432d-af3d-38df69f4cee1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.846961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1134/2274] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:05.851178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dfbe2-ffb1-478e-9478-b254fbf331df admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:05.862691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dfbe2-ffb1-478e-9478-b254fbf331df admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:05.869253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:05.871747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.871747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.871747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] PATH_INFO: `/v3/projects/866834e5860b405eab75e587aa788a3e/users/edb7fd0db9f54634857e85ae1afe40bc/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.872897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866834e5860b405eab75e587aa788a3e, user_id=edb7fd0db9f54634857e85ae1afe40bc, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:05.875735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:05.888829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1141/2275] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:05 2022] PUT /identity/v3/projects/866834e5860b405eab75e587aa788a3e/users/edb7fd0db9f54634857e85ae1afe40bc/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:05.898957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d04f9-6c58-419c-bb0f-f10fbfa99ec1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:05.899254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d04f9-6c58-419c-bb0f-f10fbfa99ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:05.899546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d04f9-6c58-419c-bb0f-f10fbfa99ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:05.927293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ed4d04f9-6c58-419c-bb0f-f10fbfa99ec1 None None] MFA Rules not processed for user `edb7fd0db9f54634857e85ae1afe40bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:05.928535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed4d04f9-6c58-419c-bb0f-f10fbfa99ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:05.998074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1135/2276] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:06.008723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:06.011049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:06.033965 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:06.069499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe84fe-6424-42b6-bd89-c5b1efa8e281 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:06.074043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027f06f-f133-452c-b7a5-2771b1de8130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:06.074698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027f06f-f133-452c-b7a5-2771b1de8130 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:06.074992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027f06f-f133-452c-b7a5-2771b1de8130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:06.075268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027f06f-f133-452c-b7a5-2771b1de8130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:06.084466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027f06f-f133-452c-b7a5-2771b1de8130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:06.085883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027f06f-f133-452c-b7a5-2771b1de8130 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:06.095526 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1142/2277] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:06.235617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d04f9-6c58-419c-bb0f-f10fbfa99ec1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:06.301341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d04f9-6c58-419c-bb0f-f10fbfa99ec1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:06.306033 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:06.307433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:06.307726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:06.308003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] PATH_INFO: `/v3/users/3618fc5aef3f41538adb4a3c690d61fb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:06.309208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3618fc5aef3f41538adb4a3c690d61fb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:06.311546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:06.332748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:06.358654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3618fc5aef3f41538adb4a3c690d61fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.359238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3618fc5aef3f41538adb4a3c690d61fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.366313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3618fc5aef3f41538adb4a3c690d61fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.379311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3618fc5aef3f41538adb4a3c690d61fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.386809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3618fc5aef3f41538adb4a3c690d61fb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.392768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1136/2278] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:06 2022] DELETE /identity/v3/users/3618fc5aef3f41538adb4a3c690d61fb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:06.397575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123ca9-e5b9-45b3-ae55-277d6a6d5bf2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:06.398035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123ca9-e5b9-45b3-ae55-277d6a6d5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:06.398152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123ca9-e5b9-45b3-ae55-277d6a6d5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:06.416612 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c2123ca9-e5b9-45b3-ae55-277d6a6d5bf2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:06.417877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c2123ca9-e5b9-45b3-ae55-277d6a6d5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:06.477321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1143/2279] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:06.487719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:06.489162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:06.552446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34edc83-31dd-4bdb-b9b3-8a620cd33ac9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:06.559287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30eda-1b25-46eb-837b-f18663b100b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:06.559992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30eda-1b25-46eb-837b-f18663b100b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:06.560286 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30eda-1b25-46eb-837b-f18663b100b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:06.560574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30eda-1b25-46eb-837b-f18663b100b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:06.570587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30eda-1b25-46eb-837b-f18663b100b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:06.572093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30eda-1b25-46eb-837b-f18663b100b8 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:06.581847 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1137/2280] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:06.876910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2123ca9-e5b9-45b3-ae55-277d6a6d5bf2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:06.878609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c2123ca9-e5b9-45b3-ae55-277d6a6d5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:06.897370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2123ca9-e5b9-45b3-ae55-277d6a6d5bf2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:06.905028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:06.906248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:06.906557 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:06.906840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] PATH_INFO: `/v3/projects/955f223ab8a1462aba7e46e0653bf237` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:06.908221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=955f223ab8a1462aba7e46e0653bf237)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:06.910370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:06.961249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955f223ab8a1462aba7e46e0653bf237', 'request_id': 'req-4402f6ab-5b82-458e-969b-b24ee582a80e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.968040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955f223ab8a1462aba7e46e0653bf237', 'request_id': 'req-4402f6ab-5b82-458e-969b-b24ee582a80e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.981187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955f223ab8a1462aba7e46e0653bf237', 'request_id': 'req-4402f6ab-5b82-458e-969b-b24ee582a80e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.994125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] The token cache is being invalidate because project 955f223ab8a1462aba7e46e0653bf237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:06.994517 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.995200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:06.996799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1144/2281] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:06 2022] DELETE /identity/v3/projects/955f223ab8a1462aba7e46e0653bf237 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:07:07.000947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30eda-1b25-46eb-837b-f18663b100b8 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:07.010972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30eda-1b25-46eb-837b-f18663b100b8 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:07.071316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:07.072823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.073146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.073453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] PATH_INFO: `/v3/users/edb7fd0db9f54634857e85ae1afe40bc` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.074724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb7fd0db9f54634857e85ae1afe40bc)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:07.076650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:07.117933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:07.123218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb7fd0db9f54634857e85ae1afe40bc'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.124121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb7fd0db9f54634857e85ae1afe40bc'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.131832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb7fd0db9f54634857e85ae1afe40bc'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.144744 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb7fd0db9f54634857e85ae1afe40bc'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.152144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9f0bfede-4d6b-453f-b699-2328f4ec8339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb7fd0db9f54634857e85ae1afe40bc'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.158269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1138/2282] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:06 2022] DELETE /identity/v3/users/edb7fd0db9f54634857e85ae1afe40bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:07.433645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:07.435170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:07.451718 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f6ab-5b82-458e-969b-b24ee582a80e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:07.496617 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:07.511243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:07.512044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.512336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.512618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] PATH_INFO: `/v3/projects/866834e5860b405eab75e587aa788a3e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.513878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] RBAC: Authorizing `identity:delete_project(project_id=866834e5860b405eab75e587aa788a3e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:07.515812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:07.562847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866834e5860b405eab75e587aa788a3e', 'request_id': 'req-c833dbc4-ae37-435a-a19e-85471f5298be'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.569005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866834e5860b405eab75e587aa788a3e', 'request_id': 'req-c833dbc4-ae37-435a-a19e-85471f5298be'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.577279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866834e5860b405eab75e587aa788a3e', 'request_id': 'req-c833dbc4-ae37-435a-a19e-85471f5298be'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.587816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] The token cache is being invalidate because project 866834e5860b405eab75e587aa788a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:07.588188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.588852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c833dbc4-ae37-435a-a19e-85471f5298be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:07.590472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1145/2283] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:07 2022] DELETE /identity/v3/projects/866834e5860b405eab75e587aa788a3e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:07.595569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79bb9-b0e1-4915-9492-a8f2f7b109c2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.596053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79bb9-b0e1-4915-9492-a8f2f7b109c2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.596256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79bb9-b0e1-4915-9492-a8f2f7b109c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.613972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c3e79bb9-b0e1-4915-9492-a8f2f7b109c2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:07.615170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c3e79bb9-b0e1-4915-9492-a8f2f7b109c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:07.674994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1139/2284] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:07.683378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9eba3-afc2-43f1-b2e8-eeb985d91398 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.683673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9eba3-afc2-43f1-b2e8-eeb985d91398 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.683960 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9eba3-afc2-43f1-b2e8-eeb985d91398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.702754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f8d9eba3-afc2-43f1-b2e8-eeb985d91398 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:07.703957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8d9eba3-afc2-43f1-b2e8-eeb985d91398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:07.712413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1146/2285] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:07.716584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e79bb9-b0e1-4915-9492-a8f2f7b109c2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:07.726442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e79bb9-b0e1-4915-9492-a8f2f7b109c2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:07.731180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:07.731845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.732140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.732428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.733166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:07:07.733484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:07.735120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:07.747820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1140/2286] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:07:07.752232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9eba3-afc2-43f1-b2e8-eeb985d91398 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:07.762525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9eba3-afc2-43f1-b2e8-eeb985d91398 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:07.767151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5cacb-0baa-423c-aff3-bd086faee81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:07.767807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5cacb-0baa-423c-aff3-bd086faee81b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.768093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5cacb-0baa-423c-aff3-bd086faee81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.768374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5cacb-0baa-423c-aff3-bd086faee81b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.769064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5cacb-0baa-423c-aff3-bd086faee81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:07.771001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5cacb-0baa-423c-aff3-bd086faee81b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:07.797161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1147/2287] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:07 2022] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:07.801388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:07.812174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e53019-8bd6-4593-90a6-1fa38986a744 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:07.869493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cfff0-2c11-473b-a1e9-be5065fa5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:07.870201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cfff0-2c11-473b-a1e9-be5065fa5ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.870493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cfff0-2c11-473b-a1e9-be5065fa5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.870776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cfff0-2c11-473b-a1e9-be5065fa5ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.871472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cfff0-2c11-473b-a1e9-be5065fa5ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:07.873408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cfff0-2c11-473b-a1e9-be5065fa5ce4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:07.898855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1141/2288] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:07 2022] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:07.900624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5cacb-0baa-423c-aff3-bd086faee81b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:07.912516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5cacb-0baa-423c-aff3-bd086faee81b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:07.917833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb512ce-9410-4d01-8b6a-c1cc46459a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:07.918496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb512ce-9410-4d01-8b6a-c1cc46459a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.918779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb512ce-9410-4d01-8b6a-c1cc46459a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.919056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb512ce-9410-4d01-8b6a-c1cc46459a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.919783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb512ce-9410-4d01-8b6a-c1cc46459a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:07.921361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb512ce-9410-4d01-8b6a-c1cc46459a21 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:07.931712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1148/2289] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:07:07.935797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cfff0-2c11-473b-a1e9-be5065fa5ce4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:07.945702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cfff0-2c11-473b-a1e9-be5065fa5ce4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:07.951198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea8756-a76b-4584-877a-b37e139ba65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:07.951859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea8756-a76b-4584-877a-b37e139ba65c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.952146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea8756-a76b-4584-877a-b37e139ba65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.952423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea8756-a76b-4584-877a-b37e139ba65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:07.953147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea8756-a76b-4584-877a-b37e139ba65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:07.954772 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea8756-a76b-4584-877a-b37e139ba65c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:07.966355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1142/2290] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:07.970268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb512ce-9410-4d01-8b6a-c1cc46459a21 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:07.980672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb512ce-9410-4d01-8b6a-c1cc46459a21 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:07.985867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade982-76f5-4fa3-a6d3-88c1702924ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:07.986778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade982-76f5-4fa3-a6d3-88c1702924ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:07.987090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade982-76f5-4fa3-a6d3-88c1702924ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:07.987369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade982-76f5-4fa3-a6d3-88c1702924ab admin admin] PATH_INFO: `/v3/projects/fb75f164827e4393b88881c36fa2d948/users/9376b0c99f27408a8da6050984dd0206/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.002362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ade982-76f5-4fa3-a6d3-88c1702924ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb75f164827e4393b88881c36fa2d948, user_id=9376b0c99f27408a8da6050984dd0206, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.004996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ade982-76f5-4fa3-a6d3-88c1702924ab admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.018527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1149/2291] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:07 2022] PUT /identity/v3/projects/fb75f164827e4393b88881c36fa2d948/users/9376b0c99f27408a8da6050984dd0206/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:08.030970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5a64-c482-46ae-b771-12fbfe862407 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.031273 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5a64-c482-46ae-b771-12fbfe862407 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.031565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5a64-c482-46ae-b771-12fbfe862407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.059451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d04f5a64-c482-46ae-b771-12fbfe862407 None None] MFA Rules not processed for user `9376b0c99f27408a8da6050984dd0206`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:08.060674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d04f5a64-c482-46ae-b771-12fbfe862407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:08.072948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:08.128754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1143/2292] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:08.133248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade982-76f5-4fa3-a6d3-88c1702924ab admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:08.205809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade982-76f5-4fa3-a6d3-88c1702924ab admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:08.225162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176d4e3-63af-4e6b-becc-170e74107ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:08.225869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176d4e3-63af-4e6b-becc-170e74107ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.226156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176d4e3-63af-4e6b-becc-170e74107ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.226437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176d4e3-63af-4e6b-becc-170e74107ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.227155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176d4e3-63af-4e6b-becc-170e74107ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.229309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176d4e3-63af-4e6b-becc-170e74107ca9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.252322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:08.262554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1150/2293] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:08 2022] POST /identity/v3/projects => generated 357 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:08.266493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f5a64-c482-46ae-b771-12fbfe862407 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:08.278137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f5a64-c482-46ae-b771-12fbfe862407 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:08.334372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748b57-24a4-4e25-810c-1adac7921926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:08.335053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748b57-24a4-4e25-810c-1adac7921926 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.335347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748b57-24a4-4e25-810c-1adac7921926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.335642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748b57-24a4-4e25-810c-1adac7921926 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.336347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7748b57-24a4-4e25-810c-1adac7921926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.338440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7748b57-24a4-4e25-810c-1adac7921926 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.358019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1144/2294] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:08 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:08.362013 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176d4e3-63af-4e6b-becc-170e74107ca9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:08.373619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176d4e3-63af-4e6b-becc-170e74107ca9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:08.378287 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a45f2-6fe1-44e0-ade3-44ba7a418550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:08.378950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a45f2-6fe1-44e0-ade3-44ba7a418550 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.379234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a45f2-6fe1-44e0-ade3-44ba7a418550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.379514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a45f2-6fe1-44e0-ade3-44ba7a418550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.380303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a45f2-6fe1-44e0-ade3-44ba7a418550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.381950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a45f2-6fe1-44e0-ade3-44ba7a418550 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.393396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1151/2295] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:08.397557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748b57-24a4-4e25-810c-1adac7921926 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:08.408246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748b57-24a4-4e25-810c-1adac7921926 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:08.413056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9114-a5ee-455d-b805-9a3ff0a4e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:08.414012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9114-a5ee-455d-b805-9a3ff0a4e484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.414302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9114-a5ee-455d-b805-9a3ff0a4e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.414585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9114-a5ee-455d-b805-9a3ff0a4e484 admin admin] PATH_INFO: `/v3/projects/d9039794db3d40b5ba7864be3ff55271/users/7b43b61416a94021927d7dcecb67377a/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.430138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9114-a5ee-455d-b805-9a3ff0a4e484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9039794db3d40b5ba7864be3ff55271, user_id=7b43b61416a94021927d7dcecb67377a, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.433327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9114-a5ee-455d-b805-9a3ff0a4e484 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.447479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1145/2296] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:08 2022] PUT /identity/v3/projects/d9039794db3d40b5ba7864be3ff55271/users/7b43b61416a94021927d7dcecb67377a/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:07:08.451714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a45f2-6fe1-44e0-ade3-44ba7a418550 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:08.462065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a45f2-6fe1-44e0-ade3-44ba7a418550 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:08.537950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f5db-bc59-4ef1-b6aa-47f3afcb40c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:08.538494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f5db-bc59-4ef1-b6aa-47f3afcb40c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.538786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f5db-bc59-4ef1-b6aa-47f3afcb40c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.539073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f5db-bc59-4ef1-b6aa-47f3afcb40c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.539818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7f5db-bc59-4ef1-b6aa-47f3afcb40c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.541422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7f5db-bc59-4ef1-b6aa-47f3afcb40c7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.553595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1152/2297] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:08.558990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9114-a5ee-455d-b805-9a3ff0a4e484 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:08.573568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9114-a5ee-455d-b805-9a3ff0a4e484 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:08.578557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:08.579470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.579764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.580048 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] PATH_INFO: `/v3/projects/d9039794db3d40b5ba7864be3ff55271/users/7b43b61416a94021927d7dcecb67377a/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.582249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9039794db3d40b5ba7864be3ff55271, user_id=7b43b61416a94021927d7dcecb67377a, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.585590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.597661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1146/2298] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:08 2022] PUT /identity/v3/projects/d9039794db3d40b5ba7864be3ff55271/users/7b43b61416a94021927d7dcecb67377a/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:08.607970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83126228-5ee7-42da-a9dc-a8d2e89948c4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.608263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83126228-5ee7-42da-a9dc-a8d2e89948c4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.608549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83126228-5ee7-42da-a9dc-a8d2e89948c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.639521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-83126228-5ee7-42da-a9dc-a8d2e89948c4 None None] MFA Rules not processed for user `7b43b61416a94021927d7dcecb67377a`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:08.640745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-83126228-5ee7-42da-a9dc-a8d2e89948c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:08.709799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1153/2299] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:08.721119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:08.722948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:08.780578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12291b0-4c9c-4da6-9ce7-c437740ded02 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:08.784263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d78fc-f7f8-4421-b555-526367025c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:08.784915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d78fc-f7f8-4421-b555-526367025c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.785210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d78fc-f7f8-4421-b555-526367025c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.785490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d78fc-f7f8-4421-b555-526367025c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.795839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d78fc-f7f8-4421-b555-526367025c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.797217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d78fc-f7f8-4421-b555-526367025c4e service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.807696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1147/2300] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:08 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:08.881701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83126228-5ee7-42da-a9dc-a8d2e89948c4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:08.892101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83126228-5ee7-42da-a9dc-a8d2e89948c4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:08.897250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41974c7a-3a86-49e9-a74a-d8a6546dd2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:08.899663 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974c7a-3a86-49e9-a74a-d8a6546dd2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:08.900326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974c7a-3a86-49e9-a74a-d8a6546dd2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:08.900619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974c7a-3a86-49e9-a74a-d8a6546dd2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:08.960440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41974c7a-3a86-49e9-a74a-d8a6546dd2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:08.962006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41974c7a-3a86-49e9-a74a-d8a6546dd2d9 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:08.973302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1154/2301] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:18.802521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:18.968026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:24.147444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d78fc-f7f8-4421-b555-526367025c4e service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:24.235552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d78fc-f7f8-4421-b555-526367025c4e service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:24.240734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:24.242008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:24.242299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:24.242581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] PATH_INFO: `/v3/users/9376b0c99f27408a8da6050984dd0206` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:24.243967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9376b0c99f27408a8da6050984dd0206)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:24.245998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:24.301231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9376b0c99f27408a8da6050984dd0206'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:24.302110 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9376b0c99f27408a8da6050984dd0206'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:24.312041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9376b0c99f27408a8da6050984dd0206'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:24.327347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9376b0c99f27408a8da6050984dd0206'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:24.335804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9376b0c99f27408a8da6050984dd0206'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:24.343228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1148/2302] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:24 2022] DELETE /identity/v3/users/9376b0c99f27408a8da6050984dd0206 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:24.348114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7567c1-d458-4e81-b697-8d3f03a11978 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:24.348687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7567c1-d458-4e81-b697-8d3f03a11978 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:24.348687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7567c1-d458-4e81-b697-8d3f03a11978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:24.368128 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5b7567c1-d458-4e81-b697-8d3f03a11978 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:24.369409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5b7567c1-d458-4e81-b697-8d3f03a11978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:24.449139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1155/2303] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:24.459097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:24.460592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:24.531366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59f1-46b0-4bac-86e2-dc60685edda2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:24.536358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b7bb-bae0-4930-a429-e1d1103b16cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:24.536775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b7bb-bae0-4930-a429-e1d1103b16cc service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:24.537002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b7bb-bae0-4930-a429-e1d1103b16cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:24.537177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b7bb-bae0-4930-a429-e1d1103b16cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:24.548429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b7bb-bae0-4930-a429-e1d1103b16cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:24.549931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b7bb-bae0-4930-a429-e1d1103b16cc service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:24.560694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1149/2304] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:25.014565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7567c1-d458-4e81-b697-8d3f03a11978 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:25.016032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5b7567c1-d458-4e81-b697-8d3f03a11978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:25.029488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7567c1-d458-4e81-b697-8d3f03a11978 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:25.040163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:25.041231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:25.041563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:25.041882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] PATH_INFO: `/v3/projects/fb75f164827e4393b88881c36fa2d948` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:25.043233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb75f164827e4393b88881c36fa2d948)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:25.045317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:25.104955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb75f164827e4393b88881c36fa2d948', 'request_id': 'req-ca3b06b5-47c5-442b-b571-25ed1046e284'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.111102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb75f164827e4393b88881c36fa2d948', 'request_id': 'req-ca3b06b5-47c5-442b-b571-25ed1046e284'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.123215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb75f164827e4393b88881c36fa2d948', 'request_id': 'req-ca3b06b5-47c5-442b-b571-25ed1046e284'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.135272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] The token cache is being invalidate because project fb75f164827e4393b88881c36fa2d948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:25.135563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.136232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.143339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1156/2305] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:25 2022] DELETE /identity/v3/projects/fb75f164827e4393b88881c36fa2d948 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:25.143515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b7bb-bae0-4930-a429-e1d1103b16cc service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:25.152614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b7bb-bae0-4930-a429-e1d1103b16cc service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:25.179668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:25.226803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:25.228220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:25.228505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:25.228784 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] PATH_INFO: `/v3/users/7b43b61416a94021927d7dcecb67377a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:25.230025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b43b61416a94021927d7dcecb67377a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:25.231953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:25.286444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b43b61416a94021927d7dcecb67377a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.287111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b43b61416a94021927d7dcecb67377a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.295240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b43b61416a94021927d7dcecb67377a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.308970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b43b61416a94021927d7dcecb67377a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.316308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-78e100d4-0efc-4167-95f2-a6335737cd0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b43b61416a94021927d7dcecb67377a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.322755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1150/2306] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:25 2022] DELETE /identity/v3/users/7b43b61416a94021927d7dcecb67377a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:07:25.762882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:25.764499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:25.788428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f45b-ca85-459e-b925-81c993df4cf2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:25.788729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f45b-ca85-459e-b925-81c993df4cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:25.789022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396f45b-ca85-459e-b925-81c993df4cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:25.789795 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b06b5-47c5-442b-b571-25ed1046e284 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:25.807250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2396f45b-ca85-459e-b925-81c993df4cf2 None None] MFA Rules not processed for user `80ffae178b294666b137bf69233eef46`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:25.808467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2396f45b-ca85-459e-b925-81c993df4cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:25.861467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:25.862477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:25.862762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:25.863040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] PATH_INFO: `/v3/projects/d9039794db3d40b5ba7864be3ff55271` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:25.864261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9039794db3d40b5ba7864be3ff55271)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:25.864970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1151/2307] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:25.866342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:25.898485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:25.918759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9039794db3d40b5ba7864be3ff55271', 'request_id': 'req-ac2e356a-25dc-42aa-a356-d60df7b0e52f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.925273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9039794db3d40b5ba7864be3ff55271', 'request_id': 'req-ac2e356a-25dc-42aa-a356-d60df7b0e52f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.933213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9039794db3d40b5ba7864be3ff55271', 'request_id': 'req-ac2e356a-25dc-42aa-a356-d60df7b0e52f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.944039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] The token cache is being invalidate because project d9039794db3d40b5ba7864be3ff55271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:25.944335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.944979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac2e356a-25dc-42aa-a356-d60df7b0e52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:25.947231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1157/2308] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:25 2022] DELETE /identity/v3/projects/d9039794db3d40b5ba7864be3ff55271 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:25.952133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650b88-034f-4245-b5c5-668d0d2532bf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:25.952457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650b88-034f-4245-b5c5-668d0d2532bf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:25.952793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650b88-034f-4245-b5c5-668d0d2532bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:25.972081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fa650b88-034f-4245-b5c5-668d0d2532bf None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:25.973291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fa650b88-034f-4245-b5c5-668d0d2532bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:26.020018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:26.043155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1152/2309] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:26.051847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e3688-ff90-4329-8692-52b3f06f09c8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.052149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e3688-ff90-4329-8692-52b3f06f09c8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.052444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e3688-ff90-4329-8692-52b3f06f09c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.072705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-218e3688-ff90-4329-8692-52b3f06f09c8 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:26.073966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-218e3688-ff90-4329-8692-52b3f06f09c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:26.082057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1158/2310] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:26.086276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa650b88-034f-4245-b5c5-668d0d2532bf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.096930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa650b88-034f-4245-b5c5-668d0d2532bf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.101617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.102360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.102864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.103238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.103978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:07:26.104302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.105953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.118451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1153/2311] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:07:26.122917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e3688-ff90-4329-8692-52b3f06f09c8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.133015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e3688-ff90-4329-8692-52b3f06f09c8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.138538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.139206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.139492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.139770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.140477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.142423 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.169706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1159/2312] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:26 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:26.173962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.184665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c99e1-2c0f-4406-bb14-18a5b9f407ef admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.190434 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.192138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:26.244323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43645ae-9fce-43de-a5fc-9952d0f661bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.245005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43645ae-9fce-43de-a5fc-9952d0f661bf admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.245360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43645ae-9fce-43de-a5fc-9952d0f661bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.245604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43645ae-9fce-43de-a5fc-9952d0f661bf admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.246962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43645ae-9fce-43de-a5fc-9952d0f661bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.248264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43645ae-9fce-43de-a5fc-9952d0f661bf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.250172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57837-cd79-4901-a3ee-8d60314b9675 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.253949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.254594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.255049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.255332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.257104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:26.267951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.271751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1154/2313] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:26 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:26.271888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.273061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43645ae-9fce-43de-a5fc-9952d0f661bf admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.278987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1160/2314] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:07:26.283551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43645ae-9fce-43de-a5fc-9952d0f661bf admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.288287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549123-ae4e-4642-b224-93e0a44a8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.288963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549123-ae4e-4642-b224-93e0a44a8536 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.289254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549123-ae4e-4642-b224-93e0a44a8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.289535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549123-ae4e-4642-b224-93e0a44a8536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.290327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549123-ae4e-4642-b224-93e0a44a8536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.291946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549123-ae4e-4642-b224-93e0a44a8536 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.302255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1155/2315] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:26.307244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.318543 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24bb3d-2b79-4af8-b194-98b0b3f1ddde service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.324623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca8c8f-ea09-49a9-9818-b931ee4133aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.324623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8c8f-ea09-49a9-9818-b931ee4133aa admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.324929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8c8f-ea09-49a9-9818-b931ee4133aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.325213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8c8f-ea09-49a9-9818-b931ee4133aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.325987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca8c8f-ea09-49a9-9818-b931ee4133aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.327588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca8c8f-ea09-49a9-9818-b931ee4133aa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.337758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1161/2316] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:07:26.341895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549123-ae4e-4642-b224-93e0a44a8536 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.352042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549123-ae4e-4642-b224-93e0a44a8536 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.357230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc07be-0fd3-458c-8e21-a2ef2fb0c9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.358161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc07be-0fd3-458c-8e21-a2ef2fb0c9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.358458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc07be-0fd3-458c-8e21-a2ef2fb0c9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.358746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc07be-0fd3-458c-8e21-a2ef2fb0c9ef admin admin] PATH_INFO: `/v3/projects/dcb64695a579447d9e1a6a49999334da/users/b913de1477ff4accb87d004342a781e8/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.375232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc07be-0fd3-458c-8e21-a2ef2fb0c9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb64695a579447d9e1a6a49999334da, user_id=b913de1477ff4accb87d004342a781e8, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.377931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc07be-0fd3-458c-8e21-a2ef2fb0c9ef admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.401414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1156/2317] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:26 2022] PUT /identity/v3/projects/dcb64695a579447d9e1a6a49999334da/users/b913de1477ff4accb87d004342a781e8/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:26.403255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a890ff-1351-417d-8c5d-afe9c5856c19 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.403554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a890ff-1351-417d-8c5d-afe9c5856c19 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.403841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a890ff-1351-417d-8c5d-afe9c5856c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.431990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-57a890ff-1351-417d-8c5d-afe9c5856c19 None None] MFA Rules not processed for user `b913de1477ff4accb87d004342a781e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:26.433137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-57a890ff-1351-417d-8c5d-afe9c5856c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:26.501951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1162/2318] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:26.506457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc07be-0fd3-458c-8e21-a2ef2fb0c9ef admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.570559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc07be-0fd3-458c-8e21-a2ef2fb0c9ef admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.576021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96e41b-1b1c-4e93-9e20-4cf45ba111fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.576876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96e41b-1b1c-4e93-9e20-4cf45ba111fd admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.577430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96e41b-1b1c-4e93-9e20-4cf45ba111fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.577915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96e41b-1b1c-4e93-9e20-4cf45ba111fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.578639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96e41b-1b1c-4e93-9e20-4cf45ba111fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.580573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96e41b-1b1c-4e93-9e20-4cf45ba111fd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.611866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1157/2319] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:26 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:26.615728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a890ff-1351-417d-8c5d-afe9c5856c19 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.628071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a890ff-1351-417d-8c5d-afe9c5856c19 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.634619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:26.706212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f275011-bdc4-45d2-a13f-fc0f57319e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.706899 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275011-bdc4-45d2-a13f-fc0f57319e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.707192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275011-bdc4-45d2-a13f-fc0f57319e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.707474 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275011-bdc4-45d2-a13f-fc0f57319e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.708252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f275011-bdc4-45d2-a13f-fc0f57319e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.710212 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f275011-bdc4-45d2-a13f-fc0f57319e7a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.732145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1163/2320] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:26 2022] POST /identity/v3/users => generated 306 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:26.735789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96e41b-1b1c-4e93-9e20-4cf45ba111fd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.746617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96e41b-1b1c-4e93-9e20-4cf45ba111fd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.751517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a5d73-9c6d-4b31-b0fd-c5a5e02a61cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.752202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5d73-9c6d-4b31-b0fd-c5a5e02a61cd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.752501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5d73-9c6d-4b31-b0fd-c5a5e02a61cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.752778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5d73-9c6d-4b31-b0fd-c5a5e02a61cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.753518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a5d73-9c6d-4b31-b0fd-c5a5e02a61cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.755215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a5d73-9c6d-4b31-b0fd-c5a5e02a61cd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.767570 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1158/2321] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:26.771855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f275011-bdc4-45d2-a13f-fc0f57319e7a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.784923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f275011-bdc4-45d2-a13f-fc0f57319e7a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.790656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab9527-9c7a-46ac-9a7a-46f4a660cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.791554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab9527-9c7a-46ac-9a7a-46f4a660cfa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.791876 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab9527-9c7a-46ac-9a7a-46f4a660cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.793246 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab9527-9c7a-46ac-9a7a-46f4a660cfa6 admin admin] PATH_INFO: `/v3/projects/6ceff098ddcb40af948af6f223c83186/users/fe75b9331453441faa52ad766ecdbbd3/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.813949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab9527-9c7a-46ac-9a7a-46f4a660cfa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ceff098ddcb40af948af6f223c83186, user_id=fe75b9331453441faa52ad766ecdbbd3, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.816666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab9527-9c7a-46ac-9a7a-46f4a660cfa6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.833218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1164/2322] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:26 2022] PUT /identity/v3/projects/6ceff098ddcb40af948af6f223c83186/users/fe75b9331453441faa52ad766ecdbbd3/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:26.837943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a5d73-9c6d-4b31-b0fd-c5a5e02a61cd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.843830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:26.850848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a5d73-9c6d-4b31-b0fd-c5a5e02a61cd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.914404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb9875-c659-4b13-a218-8c9a0bc2b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.915349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb9875-c659-4b13-a218-8c9a0bc2b6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.915776 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb9875-c659-4b13-a218-8c9a0bc2b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.916134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb9875-c659-4b13-a218-8c9a0bc2b6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.916945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb9875-c659-4b13-a218-8c9a0bc2b6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.918664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb9875-c659-4b13-a218-8c9a0bc2b6b7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.928873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1159/2323] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:26.933649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab9527-9c7a-46ac-9a7a-46f4a660cfa6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:26.949260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab9527-9c7a-46ac-9a7a-46f4a660cfa6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:26.954751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:26.956747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.957039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.957324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] PATH_INFO: `/v3/projects/6ceff098ddcb40af948af6f223c83186/users/fe75b9331453441faa52ad766ecdbbd3/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:26.959715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ceff098ddcb40af948af6f223c83186, user_id=fe75b9331453441faa52ad766ecdbbd3, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:26.963364 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:26.976066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1165/2324] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:26 2022] PUT /identity/v3/projects/6ceff098ddcb40af948af6f223c83186/users/fe75b9331453441faa52ad766ecdbbd3/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:26.988118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baff30-a895-4dd1-b282-70144a2c716a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:26.988404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baff30-a895-4dd1-b282-70144a2c716a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:26.988683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baff30-a895-4dd1-b282-70144a2c716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:27.017924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-88baff30-a895-4dd1-b282-70144a2c716a None None] MFA Rules not processed for user `fe75b9331453441faa52ad766ecdbbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:27.019150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-88baff30-a895-4dd1-b282-70144a2c716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:27.091801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1160/2325] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:27.103070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:27.106394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:27.165431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04189320-95ae-4724-9df3-4db484512435 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:27.169391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b34b-fb9c-47ee-8cb4-88ee3ab3172d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:27.170070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b34b-fb9c-47ee-8cb4-88ee3ab3172d service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:27.170355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b34b-fb9c-47ee-8cb4-88ee3ab3172d service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:27.170634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b34b-fb9c-47ee-8cb4-88ee3ab3172d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:27.186986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93b34b-fb9c-47ee-8cb4-88ee3ab3172d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:27.188435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93b34b-fb9c-47ee-8cb4-88ee3ab3172d service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:27.198723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1166/2326] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:27.271415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baff30-a895-4dd1-b282-70144a2c716a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:27.281937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baff30-a895-4dd1-b282-70144a2c716a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:27.285683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555e5a3-1fa7-4df2-9bf1-07cf8202d464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:27.286332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555e5a3-1fa7-4df2-9bf1-07cf8202d464 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:27.286620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555e5a3-1fa7-4df2-9bf1-07cf8202d464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:27.286926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555e5a3-1fa7-4df2-9bf1-07cf8202d464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:27.347015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555e5a3-1fa7-4df2-9bf1-07cf8202d464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:27.348465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555e5a3-1fa7-4df2-9bf1-07cf8202d464 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:27.357975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1161/2327] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:31.494951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b34b-fb9c-47ee-8cb4-88ee3ab3172d service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:31.558743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b34b-fb9c-47ee-8cb4-88ee3ab3172d service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:31.563390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:31.564274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:31.564562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:31.564840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] PATH_INFO: `/v3/users/b913de1477ff4accb87d004342a781e8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:31.566284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b913de1477ff4accb87d004342a781e8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:31.569140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:31.574368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:31.630895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b913de1477ff4accb87d004342a781e8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:31.631691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b913de1477ff4accb87d004342a781e8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:31.639423 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b913de1477ff4accb87d004342a781e8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:31.646884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b913de1477ff4accb87d004342a781e8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:31.647785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b913de1477ff4accb87d004342a781e8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:31.666117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1167/2328] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:31 2022] DELETE /identity/v3/users/b913de1477ff4accb87d004342a781e8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:31.670585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385d79e-50e7-4611-8ab4-f0810b9cf2e1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:31.671093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385d79e-50e7-4611-8ab4-f0810b9cf2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:31.671201 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385d79e-50e7-4611-8ab4-f0810b9cf2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:31.688741 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a385d79e-50e7-4611-8ab4-f0810b9cf2e1 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:31.689970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a385d79e-50e7-4611-8ab4-f0810b9cf2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:31.707679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:31.758102 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1162/2329] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:31.768356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:31.769799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:31.829690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af60fe-d567-4029-af84-7941129c4b52 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:31.834047 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4070b8-621b-43a0-aabb-c6fe480a3f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:31.834713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4070b8-621b-43a0-aabb-c6fe480a3f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:31.835002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4070b8-621b-43a0-aabb-c6fe480a3f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:31.835286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4070b8-621b-43a0-aabb-c6fe480a3f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:31.845552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4070b8-621b-43a0-aabb-c6fe480a3f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:31.847012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4070b8-621b-43a0-aabb-c6fe480a3f54 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:31.858459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1168/2330] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:32.162224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385d79e-50e7-4611-8ab4-f0810b9cf2e1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:32.163723 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a385d79e-50e7-4611-8ab4-f0810b9cf2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:32.182127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385d79e-50e7-4611-8ab4-f0810b9cf2e1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:32.189309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:32.190245 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:32.190566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:32.190915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] PATH_INFO: `/v3/projects/dcb64695a579447d9e1a6a49999334da` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:32.192573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb64695a579447d9e1a6a49999334da)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:32.194686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:32.245210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb64695a579447d9e1a6a49999334da', 'request_id': 'req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.253152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb64695a579447d9e1a6a49999334da', 'request_id': 'req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.259612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb64695a579447d9e1a6a49999334da', 'request_id': 'req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.271384 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] The token cache is being invalidate because project dcb64695a579447d9e1a6a49999334da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:32.271590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.272277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.274793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1163/2331] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:32 2022] DELETE /identity/v3/projects/dcb64695a579447d9e1a6a49999334da => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:32.278974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4070b8-621b-43a0-aabb-c6fe480a3f54 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:32.289096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4070b8-621b-43a0-aabb-c6fe480a3f54 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:32.347937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:32.348816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:32.349101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:32.349379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] PATH_INFO: `/v3/users/fe75b9331453441faa52ad766ecdbbd3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:32.350640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe75b9331453441faa52ad766ecdbbd3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:32.352806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:32.386331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:32.410917 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe75b9331453441faa52ad766ecdbbd3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.411843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe75b9331453441faa52ad766ecdbbd3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.419425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe75b9331453441faa52ad766ecdbbd3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.429800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe75b9331453441faa52ad766ecdbbd3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.431704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34ca09a5-3201-4fca-aa22-7e155cbfa45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe75b9331453441faa52ad766ecdbbd3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.451219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1169/2332] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:32 2022] DELETE /identity/v3/users/fe75b9331453441faa52ad766ecdbbd3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:32.826387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:32.827858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:32.842294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643eef9-2ff2-4954-a640-d0f7ff8fd36e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:32.909146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:32.910054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:32.910349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:32.910635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] PATH_INFO: `/v3/projects/6ceff098ddcb40af948af6f223c83186` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:32.912131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ceff098ddcb40af948af6f223c83186)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:32.914115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:32.959496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:32.960721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ceff098ddcb40af948af6f223c83186', 'request_id': 'req-66934bf6-5c6b-4b0e-9d50-2f36df08934f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.968337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ceff098ddcb40af948af6f223c83186', 'request_id': 'req-66934bf6-5c6b-4b0e-9d50-2f36df08934f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.974059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ceff098ddcb40af948af6f223c83186', 'request_id': 'req-66934bf6-5c6b-4b0e-9d50-2f36df08934f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.985369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] The token cache is being invalidate because project 6ceff098ddcb40af948af6f223c83186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:32.985693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.986350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-66934bf6-5c6b-4b0e-9d50-2f36df08934f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:32.987908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1164/2333] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:32 2022] DELETE /identity/v3/projects/6ceff098ddcb40af948af6f223c83186 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:32.993956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34b70-9321-4ad6-a38c-43720225bf53 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:32.994455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34b70-9321-4ad6-a38c-43720225bf53 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:32.994577 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34b70-9321-4ad6-a38c-43720225bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.012524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f9f34b70-9321-4ad6-a38c-43720225bf53 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:33.013764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f9f34b70-9321-4ad6-a38c-43720225bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:33.072011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1170/2334] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:07:33.079693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f3ddf-3edf-4806-83b8-2af0387354cc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.080028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f3ddf-3edf-4806-83b8-2af0387354cc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.080318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f3ddf-3edf-4806-83b8-2af0387354cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.102374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-af3f3ddf-3edf-4806-83b8-2af0387354cc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:33.103979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af3f3ddf-3edf-4806-83b8-2af0387354cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:33.112383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1165/2335] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:33.116973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f34b70-9321-4ad6-a38c-43720225bf53 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.127423 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f34b70-9321-4ad6-a38c-43720225bf53 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.132114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.132766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.133130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.133430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.134194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:07:33.134515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.136139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.147493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1171/2336] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:07:33.151769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f3ddf-3edf-4806-83b8-2af0387354cc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.165498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f3ddf-3edf-4806-83b8-2af0387354cc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.170753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad732d4-ec2c-4206-82a5-8926f130a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.171604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad732d4-ec2c-4206-82a5-8926f130a08b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.171983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad732d4-ec2c-4206-82a5-8926f130a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.172379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad732d4-ec2c-4206-82a5-8926f130a08b admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.173173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad732d4-ec2c-4206-82a5-8926f130a08b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.175478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad732d4-ec2c-4206-82a5-8926f130a08b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.204848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1166/2337] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:33 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:33.208875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.218990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25cea-07dd-4f80-b842-8e447023d244 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.274651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a34f-4a02-49b8-8e4c-7b8321bfebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.275326 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a34f-4a02-49b8-8e4c-7b8321bfebae admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.275615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a34f-4a02-49b8-8e4c-7b8321bfebae admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.275903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a34f-4a02-49b8-8e4c-7b8321bfebae admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.276606 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6a34f-4a02-49b8-8e4c-7b8321bfebae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.278571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6a34f-4a02-49b8-8e4c-7b8321bfebae admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.298875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1172/2338] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:33 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:33.303180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad732d4-ec2c-4206-82a5-8926f130a08b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.314517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad732d4-ec2c-4206-82a5-8926f130a08b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.319210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e2e54-e545-4fdf-9f67-b19bba6a45a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.319874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e2e54-e545-4fdf-9f67-b19bba6a45a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.320167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e2e54-e545-4fdf-9f67-b19bba6a45a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.320455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e2e54-e545-4fdf-9f67-b19bba6a45a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.321313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e2e54-e545-4fdf-9f67-b19bba6a45a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.323024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e2e54-e545-4fdf-9f67-b19bba6a45a7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.333620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1167/2339] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:33.337729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a34f-4a02-49b8-8e4c-7b8321bfebae admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.347824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a34f-4a02-49b8-8e4c-7b8321bfebae admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.353286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29231262-b2e4-47a9-8960-3507160fd539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.354011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29231262-b2e4-47a9-8960-3507160fd539 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.354329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29231262-b2e4-47a9-8960-3507160fd539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.354614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29231262-b2e4-47a9-8960-3507160fd539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.355339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29231262-b2e4-47a9-8960-3507160fd539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.356962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29231262-b2e4-47a9-8960-3507160fd539 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.367179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1173/2340] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:33.372198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e2e54-e545-4fdf-9f67-b19bba6a45a7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.382243 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e2e54-e545-4fdf-9f67-b19bba6a45a7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.387063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.387939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.388229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.388515 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] PATH_INFO: `/v3/projects/d8a424f3df234673a0d428f4e08bca24/users/dcdd3c4c5405404d82b5fff906179f08/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.403980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a424f3df234673a0d428f4e08bca24, user_id=dcdd3c4c5405404d82b5fff906179f08, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.406689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.420464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1168/2341] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:33 2022] PUT /identity/v3/projects/d8a424f3df234673a0d428f4e08bca24/users/dcdd3c4c5405404d82b5fff906179f08/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:33.431639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24561-5aa1-4373-a550-7c6e81f0777b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.431936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24561-5aa1-4373-a550-7c6e81f0777b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.432225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24561-5aa1-4373-a550-7c6e81f0777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.450585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:33.460410 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-83a24561-5aa1-4373-a550-7c6e81f0777b None None] MFA Rules not processed for user `dcdd3c4c5405404d82b5fff906179f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:33.461914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-83a24561-5aa1-4373-a550-7c6e81f0777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:33.530095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1174/2342] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:33.541581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.543301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:33.600109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1051e-d940-4d95-ba20-638585a24bca admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.604774 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ed66-b65b-4427-937a-5bce3b0a1e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.605464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ed66-b65b-4427-937a-5bce3b0a1e33 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.605788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ed66-b65b-4427-937a-5bce3b0a1e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.606075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ed66-b65b-4427-937a-5bce3b0a1e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.614444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179ed66-b65b-4427-937a-5bce3b0a1e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.615894 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179ed66-b65b-4427-937a-5bce3b0a1e33 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.626034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1169/2343] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:33.644787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a24561-5aa1-4373-a550-7c6e81f0777b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.708053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a24561-5aa1-4373-a550-7c6e81f0777b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.712823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.713833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.714052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.714341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] PATH_INFO: `/v3/users/dcdd3c4c5405404d82b5fff906179f08` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.715688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcdd3c4c5405404d82b5fff906179f08)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.717659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.765286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcdd3c4c5405404d82b5fff906179f08'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:33.766012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcdd3c4c5405404d82b5fff906179f08'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:33.773216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcdd3c4c5405404d82b5fff906179f08'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:33.781728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcdd3c4c5405404d82b5fff906179f08'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:33.782366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcdd3c4c5405404d82b5fff906179f08'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:33.801653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1175/2344] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:33 2022] DELETE /identity/v3/users/dcdd3c4c5405404d82b5fff906179f08 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:33.806820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a418-761a-4f91-8e44-8f857ad1d61a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.807118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a418-761a-4f91-8e44-8f857ad1d61a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.807405 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a418-761a-4f91-8e44-8f857ad1d61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.828399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aa10a418-761a-4f91-8e44-8f857ad1d61a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:33.829618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aa10a418-761a-4f91-8e44-8f857ad1d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:33.890443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1170/2345] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:33.900750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:33.902194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:33.923752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:33.961414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be905c2-9547-4a6b-9c20-eb4fb9cf6932 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:33.965609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f7051-57ab-4399-9fb1-8cf8d78eeafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:33.966256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f7051-57ab-4399-9fb1-8cf8d78eeafe service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:33.966542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f7051-57ab-4399-9fb1-8cf8d78eeafe service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:33.966824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f7051-57ab-4399-9fb1-8cf8d78eeafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:33.975874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f7051-57ab-4399-9fb1-8cf8d78eeafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:33.977321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f7051-57ab-4399-9fb1-8cf8d78eeafe service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:33.990026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1176/2346] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:34.259436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a418-761a-4f91-8e44-8f857ad1d61a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:34.260917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aa10a418-761a-4f91-8e44-8f857ad1d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:34.273646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a418-761a-4f91-8e44-8f857ad1d61a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:34.279446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:34.280432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.280795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.281159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] PATH_INFO: `/v3/projects/d8a424f3df234673a0d428f4e08bca24` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.282478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a424f3df234673a0d428f4e08bca24)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:34.284524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:34.301349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:34.342907 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a424f3df234673a0d428f4e08bca24', 'request_id': 'req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:34.350191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a424f3df234673a0d428f4e08bca24', 'request_id': 'req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:34.355962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a424f3df234673a0d428f4e08bca24', 'request_id': 'req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:34.369887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] The token cache is being invalidate because project d8a424f3df234673a0d428f4e08bca24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:34.370186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:34.370849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c8911eb0-58cc-48d6-b0c9-62c4e47f74d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:34.372445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1171/2347] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:34 2022] DELETE /identity/v3/projects/d8a424f3df234673a0d428f4e08bca24 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:07:34.377327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367e02-f436-49e0-bca5-9177f7249156 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.377807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367e02-f436-49e0-bca5-9177f7249156 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.377955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367e02-f436-49e0-bca5-9177f7249156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.396110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-93367e02-f436-49e0-bca5-9177f7249156 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:34.397314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-93367e02-f436-49e0-bca5-9177f7249156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:34.460368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1177/2348] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:07:34.469641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760893e9-bff2-4699-91ef-a93b1d38df2c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.469943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760893e9-bff2-4699-91ef-a93b1d38df2c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.470235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760893e9-bff2-4699-91ef-a93b1d38df2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.488448 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-760893e9-bff2-4699-91ef-a93b1d38df2c None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:34.489691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-760893e9-bff2-4699-91ef-a93b1d38df2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:34.497993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1172/2349] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:34.502151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93367e02-f436-49e0-bca5-9177f7249156 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:34.512729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93367e02-f436-49e0-bca5-9177f7249156 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:34.517426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:34.518122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.518412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.518693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.519420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:07:34.519734 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:34.521330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:34.536603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1178/2350] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:07:34.541635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760893e9-bff2-4699-91ef-a93b1d38df2c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:34.550628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760893e9-bff2-4699-91ef-a93b1d38df2c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:34.556147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4926d9-c8bb-4a54-8d3f-5690b0b92da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:34.556804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4926d9-c8bb-4a54-8d3f-5690b0b92da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.557092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4926d9-c8bb-4a54-8d3f-5690b0b92da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.557377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4926d9-c8bb-4a54-8d3f-5690b0b92da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.558121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4926d9-c8bb-4a54-8d3f-5690b0b92da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:34.560072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4926d9-c8bb-4a54-8d3f-5690b0b92da7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:34.586816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1173/2351] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:34 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:07:34.590781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:34.600980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeb9ed-3313-49c4-af8b-4d2fc7ed584d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:34.661747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1bfb0-4cc7-487a-890f-e5a0756a7d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:34.662456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1bfb0-4cc7-487a-890f-e5a0756a7d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.662752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1bfb0-4cc7-487a-890f-e5a0756a7d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.663037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1bfb0-4cc7-487a-890f-e5a0756a7d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.663748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1bfb0-4cc7-487a-890f-e5a0756a7d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:34.666001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1bfb0-4cc7-487a-890f-e5a0756a7d0b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:34.690338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1179/2352] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:34 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:07:34.691815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4926d9-c8bb-4a54-8d3f-5690b0b92da7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:34.702360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4926d9-c8bb-4a54-8d3f-5690b0b92da7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:34.707015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e262-64fe-4982-a16d-deddc7c9c14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:34.707677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e262-64fe-4982-a16d-deddc7c9c14b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.707960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e262-64fe-4982-a16d-deddc7c9c14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.708235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e262-64fe-4982-a16d-deddc7c9c14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.708988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2e262-64fe-4982-a16d-deddc7c9c14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:34.710674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2e262-64fe-4982-a16d-deddc7c9c14b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:34.722203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1174/2353] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:07:34.726198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1bfb0-4cc7-487a-890f-e5a0756a7d0b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:34.736824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1bfb0-4cc7-487a-890f-e5a0756a7d0b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:34.741432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24032531-0d7c-4a99-91ea-8c6a7635054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:34.742370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032531-0d7c-4a99-91ea-8c6a7635054b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.742664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032531-0d7c-4a99-91ea-8c6a7635054b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.742951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032531-0d7c-4a99-91ea-8c6a7635054b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.744056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24032531-0d7c-4a99-91ea-8c6a7635054b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:34.745685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24032531-0d7c-4a99-91ea-8c6a7635054b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:34.755552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1180/2354] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:34.759727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e262-64fe-4982-a16d-deddc7c9c14b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:34.769672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e262-64fe-4982-a16d-deddc7c9c14b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:34.774213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35248eb0-c35e-474d-9cbf-b68f3ef8c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:34.775699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248eb0-c35e-474d-9cbf-b68f3ef8c069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.775983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248eb0-c35e-474d-9cbf-b68f3ef8c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.776260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248eb0-c35e-474d-9cbf-b68f3ef8c069 admin admin] PATH_INFO: `/v3/projects/8bdf984f1fc645caa203a237fffe8fc2/users/038913eb2d994d6a8f7bb376cfc4464a/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.791580 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35248eb0-c35e-474d-9cbf-b68f3ef8c069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdf984f1fc645caa203a237fffe8fc2, user_id=038913eb2d994d6a8f7bb376cfc4464a, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:34.794259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35248eb0-c35e-474d-9cbf-b68f3ef8c069 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:34.806725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1175/2355] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:34 2022] PUT /identity/v3/projects/8bdf984f1fc645caa203a237fffe8fc2/users/038913eb2d994d6a8f7bb376cfc4464a/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:34.818442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e72e2-5a23-485c-8aeb-9bd8c78c2543 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:34.818905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e72e2-5a23-485c-8aeb-9bd8c78c2543 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:34.819292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e72e2-5a23-485c-8aeb-9bd8c78c2543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:34.849600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-070e72e2-5a23-485c-8aeb-9bd8c78c2543 None None] MFA Rules not processed for user `038913eb2d994d6a8f7bb376cfc4464a`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:34.850831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-070e72e2-5a23-485c-8aeb-9bd8c78c2543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:34.867320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:34.927742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1181/2356] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:34.932334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35248eb0-c35e-474d-9cbf-b68f3ef8c069 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:34.997039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35248eb0-c35e-474d-9cbf-b68f3ef8c069 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.001802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7edaee-c0ec-426c-b53c-0f488ab8fefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.002499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7edaee-c0ec-426c-b53c-0f488ab8fefd admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.002793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7edaee-c0ec-426c-b53c-0f488ab8fefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.003081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7edaee-c0ec-426c-b53c-0f488ab8fefd admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.003793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7edaee-c0ec-426c-b53c-0f488ab8fefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.005742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7edaee-c0ec-426c-b53c-0f488ab8fefd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.032192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1176/2357] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:34 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:35.036002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e72e2-5a23-485c-8aeb-9bd8c78c2543 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.046679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e72e2-5a23-485c-8aeb-9bd8c78c2543 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.102818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47722-3d5e-4355-9c09-e539a099e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.103487 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47722-3d5e-4355-9c09-e539a099e79a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.103778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47722-3d5e-4355-9c09-e539a099e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.104062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47722-3d5e-4355-9c09-e539a099e79a admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.104756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc47722-3d5e-4355-9c09-e539a099e79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.106717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc47722-3d5e-4355-9c09-e539a099e79a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.125619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1182/2358] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:35 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:35.129892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7edaee-c0ec-426c-b53c-0f488ab8fefd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.141429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7edaee-c0ec-426c-b53c-0f488ab8fefd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.146215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6003600-3042-438e-a0a1-52ba285dc5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.146913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6003600-3042-438e-a0a1-52ba285dc5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.147205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6003600-3042-438e-a0a1-52ba285dc5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.147496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6003600-3042-438e-a0a1-52ba285dc5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.148228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6003600-3042-438e-a0a1-52ba285dc5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.150639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6003600-3042-438e-a0a1-52ba285dc5d4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.161079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1177/2359] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:35.164878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47722-3d5e-4355-9c09-e539a099e79a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.174732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47722-3d5e-4355-9c09-e539a099e79a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.180104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e587ea1-b881-4f5c-9b5e-603d81bcf8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.181108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e587ea1-b881-4f5c-9b5e-603d81bcf8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.181431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e587ea1-b881-4f5c-9b5e-603d81bcf8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.182151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e587ea1-b881-4f5c-9b5e-603d81bcf8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.182603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e587ea1-b881-4f5c-9b5e-603d81bcf8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.184343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e587ea1-b881-4f5c-9b5e-603d81bcf8fc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.195467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1183/2360] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:35.200397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6003600-3042-438e-a0a1-52ba285dc5d4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.210493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6003600-3042-438e-a0a1-52ba285dc5d4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.215799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c304160-8d6c-4cfc-bb3f-4bd9809ad542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.216681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c304160-8d6c-4cfc-bb3f-4bd9809ad542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.216966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c304160-8d6c-4cfc-bb3f-4bd9809ad542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.217253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c304160-8d6c-4cfc-bb3f-4bd9809ad542 admin admin] PATH_INFO: `/v3/projects/7d1b21e6c6594a7185bb72f67b398b99/users/8c1d267684574610aa7cc534cab86f13/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.220316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:35.233467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c304160-8d6c-4cfc-bb3f-4bd9809ad542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1b21e6c6594a7185bb72f67b398b99, user_id=8c1d267684574610aa7cc534cab86f13, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.236103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c304160-8d6c-4cfc-bb3f-4bd9809ad542 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.248710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1178/2361] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:35 2022] PUT /identity/v3/projects/7d1b21e6c6594a7185bb72f67b398b99/users/8c1d267684574610aa7cc534cab86f13/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:35.259624 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699800e-4cbc-44cf-8f37-ef255beb119d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.259916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699800e-4cbc-44cf-8f37-ef255beb119d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.260213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699800e-4cbc-44cf-8f37-ef255beb119d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.285847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e699800e-4cbc-44cf-8f37-ef255beb119d None None] MFA Rules not processed for user `8c1d267684574610aa7cc534cab86f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:35.287039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e699800e-4cbc-44cf-8f37-ef255beb119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:35.349499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1184/2362] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:35.354517 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c304160-8d6c-4cfc-bb3f-4bd9809ad542 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.416983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c304160-8d6c-4cfc-bb3f-4bd9809ad542 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.421768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d5fb-a75a-4fa4-9c15-6ec206371e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.422436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d5fb-a75a-4fa4-9c15-6ec206371e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.422724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d5fb-a75a-4fa4-9c15-6ec206371e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.423006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1d5fb-a75a-4fa4-9c15-6ec206371e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.423697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1d5fb-a75a-4fa4-9c15-6ec206371e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.425647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1d5fb-a75a-4fa4-9c15-6ec206371e28 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.451569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1179/2363] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:35 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:35.455742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699800e-4cbc-44cf-8f37-ef255beb119d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.467961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699800e-4cbc-44cf-8f37-ef255beb119d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.489603 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:35.527062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e631-96b9-4d76-abd6-e6b14f7470dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.527731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e631-96b9-4d76-abd6-e6b14f7470dd admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.528020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e631-96b9-4d76-abd6-e6b14f7470dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.528301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e631-96b9-4d76-abd6-e6b14f7470dd admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.528982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79e631-96b9-4d76-abd6-e6b14f7470dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.530916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79e631-96b9-4d76-abd6-e6b14f7470dd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.550549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1185/2364] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:35 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:35.554603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d5fb-a75a-4fa4-9c15-6ec206371e28 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.565313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1d5fb-a75a-4fa4-9c15-6ec206371e28 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.570017 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3181c-6294-4f2f-a2d3-4fa3a8df68e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.570678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3181c-6294-4f2f-a2d3-4fa3a8df68e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.570968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3181c-6294-4f2f-a2d3-4fa3a8df68e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.571301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3181c-6294-4f2f-a2d3-4fa3a8df68e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.572181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3181c-6294-4f2f-a2d3-4fa3a8df68e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.573821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3181c-6294-4f2f-a2d3-4fa3a8df68e6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.584256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1180/2365] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:35.588786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e631-96b9-4d76-abd6-e6b14f7470dd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.598713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e631-96b9-4d76-abd6-e6b14f7470dd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.604448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc2a1f-dbef-4e1f-98cd-8514f0e7c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.605342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2a1f-dbef-4e1f-98cd-8514f0e7c894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.605675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2a1f-dbef-4e1f-98cd-8514f0e7c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.605969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2a1f-dbef-4e1f-98cd-8514f0e7c894 admin admin] PATH_INFO: `/v3/projects/1b2873fbf42a4ca2895494a7e1ceb84b/users/32a0bb36ac094e8194a6fc25ce86d143/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.621121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc2a1f-dbef-4e1f-98cd-8514f0e7c894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2873fbf42a4ca2895494a7e1ceb84b, user_id=32a0bb36ac094e8194a6fc25ce86d143, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.623820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc2a1f-dbef-4e1f-98cd-8514f0e7c894 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.636735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1186/2366] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:35 2022] PUT /identity/v3/projects/1b2873fbf42a4ca2895494a7e1ceb84b/users/32a0bb36ac094e8194a6fc25ce86d143/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:35.640807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3181c-6294-4f2f-a2d3-4fa3a8df68e6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.651761 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3181c-6294-4f2f-a2d3-4fa3a8df68e6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.708600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0e20-7b9f-4184-a38d-48291dbfc6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.709308 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0e20-7b9f-4184-a38d-48291dbfc6af admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.709631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0e20-7b9f-4184-a38d-48291dbfc6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.709920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0e20-7b9f-4184-a38d-48291dbfc6af admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.710658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f0e20-7b9f-4184-a38d-48291dbfc6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.712872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f0e20-7b9f-4184-a38d-48291dbfc6af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.722787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1181/2367] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:35.726930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc2a1f-dbef-4e1f-98cd-8514f0e7c894 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.737227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc2a1f-dbef-4e1f-98cd-8514f0e7c894 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.742197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.743041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.743370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.743655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] PATH_INFO: `/v3/projects/1b2873fbf42a4ca2895494a7e1ceb84b/users/32a0bb36ac094e8194a6fc25ce86d143/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.745694 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2873fbf42a4ca2895494a7e1ceb84b, user_id=32a0bb36ac094e8194a6fc25ce86d143, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:35.748373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:35.758288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1187/2368] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:35 2022] PUT /identity/v3/projects/1b2873fbf42a4ca2895494a7e1ceb84b/users/32a0bb36ac094e8194a6fc25ce86d143/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:35.822120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbed31-93a5-427b-8c59-50d45093b40c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.822417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbed31-93a5-427b-8c59-50d45093b40c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.822687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbed31-93a5-427b-8c59-50d45093b40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:35.850153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-22bbed31-93a5-427b-8c59-50d45093b40c None None] MFA Rules not processed for user `32a0bb36ac094e8194a6fc25ce86d143`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:35.851992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-22bbed31-93a5-427b-8c59-50d45093b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:35.896461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:35.921401 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1182/2369] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:35.933078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:35.934790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:35.992945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c127831-84c4-4a0f-ba6c-dae5e5b1c966 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:35.996601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcefe8-47b6-452d-9081-5d67604a8e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:35.997253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcefe8-47b6-452d-9081-5d67604a8e1f service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:35.997559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcefe8-47b6-452d-9081-5d67604a8e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:35.997851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcefe8-47b6-452d-9081-5d67604a8e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:36.056693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcefe8-47b6-452d-9081-5d67604a8e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:36.058240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcefe8-47b6-452d-9081-5d67604a8e1f service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:36.067315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1188/2370] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:37.595311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbed31-93a5-427b-8c59-50d45093b40c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:37.596747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-22bbed31-93a5-427b-8c59-50d45093b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:37.609018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbed31-93a5-427b-8c59-50d45093b40c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:37.612599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e0f5b-bd84-46a8-a28c-c2c97e327c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:37.613264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0f5b-bd84-46a8-a28c-c2c97e327c23 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:37.613582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0f5b-bd84-46a8-a28c-c2c97e327c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:37.613860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0f5b-bd84-46a8-a28c-c2c97e327c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:37.670762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0f5b-bd84-46a8-a28c-c2c97e327c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:37.672240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0f5b-bd84-46a8-a28c-c2c97e327c23 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:37.681869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1183/2371] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:38.186911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcefe8-47b6-452d-9081-5d67604a8e1f service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:38.195647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcefe8-47b6-452d-9081-5d67604a8e1f service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:38.199771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1db44-f738-46cc-a8c0-79988a478614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:38.200449 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1db44-f738-46cc-a8c0-79988a478614 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:38.200756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1db44-f738-46cc-a8c0-79988a478614 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:38.201958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1db44-f738-46cc-a8c0-79988a478614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:38.211583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1db44-f738-46cc-a8c0-79988a478614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:38.213334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1db44-f738-46cc-a8c0-79988a478614 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:38.223653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1189/2372] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:42.119426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e0f5b-bd84-46a8-a28c-c2c97e327c23 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:42.182732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e0f5b-bd84-46a8-a28c-c2c97e327c23 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:42.187307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:42.188178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:42.188468 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:42.188752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] PATH_INFO: `/v3/users/038913eb2d994d6a8f7bb376cfc4464a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:42.189977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=038913eb2d994d6a8f7bb376cfc4464a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:42.191901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:42.236805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038913eb2d994d6a8f7bb376cfc4464a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.237457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038913eb2d994d6a8f7bb376cfc4464a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.244577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038913eb2d994d6a8f7bb376cfc4464a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.256451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038913eb2d994d6a8f7bb376cfc4464a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.263336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038913eb2d994d6a8f7bb376cfc4464a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.264766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:42.270821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1184/2373] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:42 2022] DELETE /identity/v3/users/038913eb2d994d6a8f7bb376cfc4464a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:42.276130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb779-43bb-49ce-b148-d1f8d39e8443 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:42.276598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb779-43bb-49ce-b148-d1f8d39e8443 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:42.276691 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb779-43bb-49ce-b148-d1f8d39e8443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:42.294014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-85fbb779-43bb-49ce-b148-d1f8d39e8443 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:42.295203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-85fbb779-43bb-49ce-b148-d1f8d39e8443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:42.307514 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:42.356752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1190/2374] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:42.366232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:42.367960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:42.427901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8bda1-d600-4d05-abe5-285163adccfb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:42.431913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2a7f5-dd58-45f1-a99c-e06c4830b091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:42.432570 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2a7f5-dd58-45f1-a99c-e06c4830b091 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:42.432897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2a7f5-dd58-45f1-a99c-e06c4830b091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:42.433187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2a7f5-dd58-45f1-a99c-e06c4830b091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:42.442521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2a7f5-dd58-45f1-a99c-e06c4830b091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:42.443971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2a7f5-dd58-45f1-a99c-e06c4830b091 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:42.454186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1185/2375] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:42.720593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb779-43bb-49ce-b148-d1f8d39e8443 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:42.722075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-85fbb779-43bb-49ce-b148-d1f8d39e8443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:42.735256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb779-43bb-49ce-b148-d1f8d39e8443 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:42.739895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:42.740761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:42.741052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:42.741356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] PATH_INFO: `/v3/projects/8bdf984f1fc645caa203a237fffe8fc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:42.742823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bdf984f1fc645caa203a237fffe8fc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:42.745566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:42.791351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bdf984f1fc645caa203a237fffe8fc2', 'request_id': 'req-3aa1b195-aaa4-413b-9aab-db23b3fefe95'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.797288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bdf984f1fc645caa203a237fffe8fc2', 'request_id': 'req-3aa1b195-aaa4-413b-9aab-db23b3fefe95'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.806072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bdf984f1fc645caa203a237fffe8fc2', 'request_id': 'req-3aa1b195-aaa4-413b-9aab-db23b3fefe95'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.816181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] The token cache is being invalidate because project 8bdf984f1fc645caa203a237fffe8fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:42.816470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.817090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.818703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1191/2376] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:42 2022] DELETE /identity/v3/projects/8bdf984f1fc645caa203a237fffe8fc2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:42.823304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2a7f5-dd58-45f1-a99c-e06c4830b091 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:42.832896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2a7f5-dd58-45f1-a99c-e06c4830b091 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:42.888649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:42.889444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:42.889759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:42.890041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] PATH_INFO: `/v3/users/8c1d267684574610aa7cc534cab86f13` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:42.891210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1d267684574610aa7cc534cab86f13)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:42.893142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:42.939688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1d267684574610aa7cc534cab86f13'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.940339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1d267684574610aa7cc534cab86f13'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.948812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1d267684574610aa7cc534cab86f13'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.964029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1d267684574610aa7cc534cab86f13'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.971119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1d267684574610aa7cc534cab86f13'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:42.977153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1186/2377] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:42 2022] DELETE /identity/v3/users/8c1d267684574610aa7cc534cab86f13 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:43.269354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:43.270929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:43.285252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1b195-aaa4-413b-9aab-db23b3fefe95 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:43.343312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:43.344214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:43.344495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:43.344790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] PATH_INFO: `/v3/projects/7d1b21e6c6594a7185bb72f67b398b99` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:43.346010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1b21e6c6594a7185bb72f67b398b99)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:43.347921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:43.390208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:43.394867 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1b21e6c6594a7185bb72f67b398b99', 'request_id': 'req-993ab0b6-c8fd-4114-84c7-1936f4f1af74'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.403977 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1b21e6c6594a7185bb72f67b398b99', 'request_id': 'req-993ab0b6-c8fd-4114-84c7-1936f4f1af74'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.411845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1b21e6c6594a7185bb72f67b398b99', 'request_id': 'req-993ab0b6-c8fd-4114-84c7-1936f4f1af74'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.422769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] The token cache is being invalidate because project 7d1b21e6c6594a7185bb72f67b398b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:43.423084 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.423754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.425334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1192/2378] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:43 2022] DELETE /identity/v3/projects/7d1b21e6c6594a7185bb72f67b398b99 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:07:43.429325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:43.430898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:43.443579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3eea2-7d5a-4874-aeb5-7d7bfecb338c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:43.460053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:43.502351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:43.503269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:43.503563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:43.503886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] PATH_INFO: `/v3/users/32a0bb36ac094e8194a6fc25ce86d143` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:43.505050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a0bb36ac094e8194a6fc25ce86d143)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:43.507028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:43.552928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a0bb36ac094e8194a6fc25ce86d143'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.553611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a0bb36ac094e8194a6fc25ce86d143'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.561579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a0bb36ac094e8194a6fc25ce86d143'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.574492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a0bb36ac094e8194a6fc25ce86d143'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.581254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-436ae4f9-c1db-4d6c-81f4-8768cba5f134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a0bb36ac094e8194a6fc25ce86d143'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:43.587295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1187/2379] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:07:43 2022] DELETE /identity/v3/users/32a0bb36ac094e8194a6fc25ce86d143 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:07:43.866926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:43.868952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:43.884264 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab0b6-c8fd-4114-84c7-1936f4f1af74 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:43.945732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:43.946726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:43.947015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:43.947300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] PATH_INFO: `/v3/projects/1b2873fbf42a4ca2895494a7e1ceb84b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:43.948512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2873fbf42a4ca2895494a7e1ceb84b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:43.950652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:44.005162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2873fbf42a4ca2895494a7e1ceb84b', 'request_id': 'req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:44.011675 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2873fbf42a4ca2895494a7e1ceb84b', 'request_id': 'req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:44.019088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2873fbf42a4ca2895494a7e1ceb84b', 'request_id': 'req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:44.029732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] The token cache is being invalidate because project 1b2873fbf42a4ca2895494a7e1ceb84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:07:44.030028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:44.030662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7d2f4ed5-211a-4947-921d-a229f7a4b8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:07:44.032213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1193/2380] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:07:43 2022] DELETE /identity/v3/projects/1b2873fbf42a4ca2895494a7e1ceb84b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:07:44.037122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7685d-5ad3-415c-916a-a411eb0118e5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.037419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7685d-5ad3-415c-916a-a411eb0118e5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.037751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7685d-5ad3-415c-916a-a411eb0118e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.056643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-67d7685d-5ad3-415c-916a-a411eb0118e5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:44.057856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-67d7685d-5ad3-415c-916a-a411eb0118e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:44.117030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1188/2381] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:44.125477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8475e-1164-42e7-b8f5-f7b3155e3a73 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.125803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8475e-1164-42e7-b8f5-f7b3155e3a73 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.126087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8475e-1164-42e7-b8f5-f7b3155e3a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.144270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9dd8475e-1164-42e7-b8f5-f7b3155e3a73 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:44.145464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9dd8475e-1164-42e7-b8f5-f7b3155e3a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:44.153567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1194/2382] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:44.157671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7685d-5ad3-415c-916a-a411eb0118e5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:44.168240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7685d-5ad3-415c-916a-a411eb0118e5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:44.172838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:44.173496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.173810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.174091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.174819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:07:44.175172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:44.176745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:44.188643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1189/2383] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:07:44.192845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8475e-1164-42e7-b8f5-f7b3155e3a73 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:44.202890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8475e-1164-42e7-b8f5-f7b3155e3a73 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:44.207524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a425a9-d841-45bb-bf97-492194c90ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:44.208178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a425a9-d841-45bb-bf97-492194c90ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.208465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a425a9-d841-45bb-bf97-492194c90ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.208745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a425a9-d841-45bb-bf97-492194c90ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.209428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a425a9-d841-45bb-bf97-492194c90ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:44.211340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a425a9-d841-45bb-bf97-492194c90ce0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:44.237008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1195/2384] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:07:44 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:44.241242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:44.251526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56770a88-c6c7-4d94-9fe4-39e52a0afefb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:44.276402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:44.308840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55d2b5-a764-4fd8-a0f5-c6cf7b864df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:44.309511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55d2b5-a764-4fd8-a0f5-c6cf7b864df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.309839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55d2b5-a764-4fd8-a0f5-c6cf7b864df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.310121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55d2b5-a764-4fd8-a0f5-c6cf7b864df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.310805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55d2b5-a764-4fd8-a0f5-c6cf7b864df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:44.312750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55d2b5-a764-4fd8-a0f5-c6cf7b864df0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:44.333078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1190/2385] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:07:44 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:07:44.337536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a425a9-d841-45bb-bf97-492194c90ce0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:44.347820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a425a9-d841-45bb-bf97-492194c90ce0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:44.352371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20b42-f4a6-4b2d-9485-eb945a015cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:44.353030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20b42-f4a6-4b2d-9485-eb945a015cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.353317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20b42-f4a6-4b2d-9485-eb945a015cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.353640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20b42-f4a6-4b2d-9485-eb945a015cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.354367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba20b42-f4a6-4b2d-9485-eb945a015cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:44.355957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba20b42-f4a6-4b2d-9485-eb945a015cd0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:44.366016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1196/2386] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:44.370994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55d2b5-a764-4fd8-a0f5-c6cf7b864df0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:44.381052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55d2b5-a764-4fd8-a0f5-c6cf7b864df0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:44.386455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b16c-ed65-4ff5-aa02-65ba1eeeab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:44.387120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b16c-ed65-4ff5-aa02-65ba1eeeab61 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.387417 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b16c-ed65-4ff5-aa02-65ba1eeeab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.387703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b16c-ed65-4ff5-aa02-65ba1eeeab61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.388435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444b16c-ed65-4ff5-aa02-65ba1eeeab61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:44.390142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444b16c-ed65-4ff5-aa02-65ba1eeeab61 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:44.402537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1191/2387] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:07:44.407004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20b42-f4a6-4b2d-9485-eb945a015cd0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:44.417467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20b42-f4a6-4b2d-9485-eb945a015cd0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:44.422706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:44.423641 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.423928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.424208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] PATH_INFO: `/v3/projects/4c850bf3258e4e1e9ea9bc22b9b73716/users/9e95f25f2fa440c6b1ff139740a2fbe9/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.439383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c850bf3258e4e1e9ea9bc22b9b73716, user_id=9e95f25f2fa440c6b1ff139740a2fbe9, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:44.442106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:44.450335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:07:44.456970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1197/2388] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:07:44 2022] PUT /identity/v3/projects/4c850bf3258e4e1e9ea9bc22b9b73716/users/9e95f25f2fa440c6b1ff139740a2fbe9/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:07:44.468578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241e27-c271-471b-87b4-4b843bc7b95c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.469082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241e27-c271-471b-87b4-4b843bc7b95c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.469188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241e27-c271-471b-87b4-4b843bc7b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.496104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f5241e27-c271-471b-87b4-4b843bc7b95c None None] MFA Rules not processed for user `9e95f25f2fa440c6b1ff139740a2fbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:07:44.497330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f5241e27-c271-471b-87b4-4b843bc7b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:44.560910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1192/2389] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:07:44.572750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:44.574457 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:44.629738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316e7c-c907-4e52-95a5-e75201ff2bd7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:44.633335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aa1c7-fe41-4bc7-94e1-a34d7bddc8b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:44.634641 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aa1c7-fe41-4bc7-94e1-a34d7bddc8b2 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:44.634925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aa1c7-fe41-4bc7-94e1-a34d7bddc8b2 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:44.635201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aa1c7-fe41-4bc7-94e1-a34d7bddc8b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:44.643438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aa1c7-fe41-4bc7-94e1-a34d7bddc8b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:44.644844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aa1c7-fe41-4bc7-94e1-a34d7bddc8b2 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:44.653440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1198/2390] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:07:53.362771 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241e27-c271-471b-87b4-4b843bc7b95c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:07:53.364707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f5241e27-c271-471b-87b4-4b843bc7b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:53.440988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241e27-c271-471b-87b4-4b843bc7b95c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:07:53.446134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e3dde-cdfb-4116-8c72-f22f6db7bb23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:07:53.446787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3dde-cdfb-4116-8c72-f22f6db7bb23 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:07:53.447072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3dde-cdfb-4116-8c72-f22f6db7bb23 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:07:53.447349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3dde-cdfb-4116-8c72-f22f6db7bb23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:07:53.449855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-329e3dde-cdfb-4116-8c72-f22f6db7bb23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:07:53.462073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3dde-cdfb-4116-8c72-f22f6db7bb23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:07:53.464087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3dde-cdfb-4116-8c72-f22f6db7bb23 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:07:53.476214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1193/2391] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:07:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:07:54.649534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=27 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:03.471716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:23.732875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aa1c7-fe41-4bc7-94e1-a34d7bddc8b2 service glance] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:23.795720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aa1c7-fe41-4bc7-94e1-a34d7bddc8b2 service glance] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:23.800294 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:23.801166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:23.801455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:23.801896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] PATH_INFO: `/v3/users/9e95f25f2fa440c6b1ff139740a2fbe9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:23.803089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e95f25f2fa440c6b1ff139740a2fbe9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:23.805059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:23.864150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e95f25f2fa440c6b1ff139740a2fbe9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:23.864712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e95f25f2fa440c6b1ff139740a2fbe9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:23.872817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e95f25f2fa440c6b1ff139740a2fbe9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:23.880749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e95f25f2fa440c6b1ff139740a2fbe9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:23.881616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e95f25f2fa440c6b1ff139740a2fbe9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:23.899809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1199/2392] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:08:23 2022] DELETE /identity/v3/users/9e95f25f2fa440c6b1ff139740a2fbe9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:08:23.904654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856ad5-94ec-43aa-9475-e898ad8d287e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:23.905155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856ad5-94ec-43aa-9475-e898ad8d287e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:23.905260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856ad5-94ec-43aa-9475-e898ad8d287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:23.922817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d6856ad5-94ec-43aa-9475-e898ad8d287e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:23.924019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d6856ad5-94ec-43aa-9475-e898ad8d287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:23.983881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1194/2393] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:08:23.993690 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:23.995213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:24.057634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea533724-d17d-4f72-bce9-d429c8960ec8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:24.062359 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed62acb-9dea-4a46-956b-9a2bbd99cd8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:24.063186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62acb-9dea-4a46-956b-9a2bbd99cd8a service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.063477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62acb-9dea-4a46-956b-9a2bbd99cd8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.063759 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62acb-9dea-4a46-956b-9a2bbd99cd8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.073393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed62acb-9dea-4a46-956b-9a2bbd99cd8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:24.074851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed62acb-9dea-4a46-956b-9a2bbd99cd8a service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:24.084306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1200/2394] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:08:24.354996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6856ad5-94ec-43aa-9475-e898ad8d287e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:24.357200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d6856ad5-94ec-43aa-9475-e898ad8d287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:24.370337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6856ad5-94ec-43aa-9475-e898ad8d287e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:24.377429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:24.378341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.379703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.380344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] PATH_INFO: `/v3/projects/4c850bf3258e4e1e9ea9bc22b9b73716` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.381659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c850bf3258e4e1e9ea9bc22b9b73716)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:24.383625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:24.441824 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c850bf3258e4e1e9ea9bc22b9b73716', 'request_id': 'req-abd95ef4-ae62-4435-a0c0-97e2525dd21c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:24.449349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c850bf3258e4e1e9ea9bc22b9b73716', 'request_id': 'req-abd95ef4-ae62-4435-a0c0-97e2525dd21c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:24.454997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c850bf3258e4e1e9ea9bc22b9b73716', 'request_id': 'req-abd95ef4-ae62-4435-a0c0-97e2525dd21c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:24.466881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] The token cache is being invalidate because project 4c850bf3258e4e1e9ea9bc22b9b73716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:08:24.467343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:24.467991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-abd95ef4-ae62-4435-a0c0-97e2525dd21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:08:24.469583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1195/2395] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:08:24 2022] DELETE /identity/v3/projects/4c850bf3258e4e1e9ea9bc22b9b73716 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:08:24.475713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d2f2-e9ee-4f65-b4fb-d216c4a07986 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.476034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d2f2-e9ee-4f65-b4fb-d216c4a07986 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.476314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d2f2-e9ee-4f65-b4fb-d216c4a07986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.494576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0fd7d2f2-e9ee-4f65-b4fb-d216c4a07986 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:24.495784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0fd7d2f2-e9ee-4f65-b4fb-d216c4a07986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:24.512251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:24.558860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1201/2396] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:08:24.566987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976acb-d30c-4eaa-9e86-dda3961ac2b0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.567281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976acb-d30c-4eaa-9e86-dda3961ac2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.567568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976acb-d30c-4eaa-9e86-dda3961ac2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.585799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0d976acb-d30c-4eaa-9e86-dda3961ac2b0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:24.587007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0d976acb-d30c-4eaa-9e86-dda3961ac2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:24.596018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1196/2397] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:08:24.599930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7d2f2-e9ee-4f65-b4fb-d216c4a07986 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:24.610323 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7d2f2-e9ee-4f65-b4fb-d216c4a07986 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:24.614911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:24.615566 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.615859 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.616148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.616895 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:08:24.617210 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:24.619110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:24.630884 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1202/2398] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:08:24.635211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976acb-d30c-4eaa-9e86-dda3961ac2b0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:24.644573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976acb-d30c-4eaa-9e86-dda3961ac2b0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:24.649225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5e80-4fd5-4b42-a856-61817423711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:24.649921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5e80-4fd5-4b42-a856-61817423711f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.650207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5e80-4fd5-4b42-a856-61817423711f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.650485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5e80-4fd5-4b42-a856-61817423711f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.651181 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a5e80-4fd5-4b42-a856-61817423711f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:24.653069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a5e80-4fd5-4b42-a856-61817423711f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:24.679006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1197/2399] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:08:24 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:08:24.682400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:24.692666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72446bf0-ab0a-4dc6-9e76-6dfa21f0c2fa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:24.754239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025191-468e-43fd-a4b6-4a141c8ce69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:24.754925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025191-468e-43fd-a4b6-4a141c8ce69b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.755215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025191-468e-43fd-a4b6-4a141c8ce69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.755506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025191-468e-43fd-a4b6-4a141c8ce69b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.756214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025191-468e-43fd-a4b6-4a141c8ce69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:24.758285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025191-468e-43fd-a4b6-4a141c8ce69b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:24.783208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1203/2400] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:08:24 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:08:24.784528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5e80-4fd5-4b42-a856-61817423711f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:24.796311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5e80-4fd5-4b42-a856-61817423711f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:24.801131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecda8dd-0743-458b-8ae2-410d0690ecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:24.801919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda8dd-0743-458b-8ae2-410d0690ecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.802289 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda8dd-0743-458b-8ae2-410d0690ecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.802637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda8dd-0743-458b-8ae2-410d0690ecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.803444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecda8dd-0743-458b-8ae2-410d0690ecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:24.805118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecda8dd-0743-458b-8ae2-410d0690ecb9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:24.817103 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1198/2401] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:08:24.821004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025191-468e-43fd-a4b6-4a141c8ce69b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:24.831717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025191-468e-43fd-a4b6-4a141c8ce69b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:24.836484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b8c77-a4b7-4d38-86da-b8437b37b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:24.837154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b8c77-a4b7-4d38-86da-b8437b37b1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.837444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b8c77-a4b7-4d38-86da-b8437b37b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.837762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b8c77-a4b7-4d38-86da-b8437b37b1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.838499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b8c77-a4b7-4d38-86da-b8437b37b1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:24.840200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b8c77-a4b7-4d38-86da-b8437b37b1c2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:24.853780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1204/2402] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:08:24.855044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecda8dd-0743-458b-8ae2-410d0690ecb9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:24.867282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecda8dd-0743-458b-8ae2-410d0690ecb9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:24.873205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:24.874794 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.875098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.875487 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] PATH_INFO: `/v3/projects/db42a04096d74e1095f331eb00e8fff9/users/64cb61cd1c734fb9abab9fe5860c0eac/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.891277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db42a04096d74e1095f331eb00e8fff9, user_id=64cb61cd1c734fb9abab9fe5860c0eac, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:24.893964 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:24.906979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1199/2403] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:08:24 2022] PUT /identity/v3/projects/db42a04096d74e1095f331eb00e8fff9/users/64cb61cd1c734fb9abab9fe5860c0eac/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:08:24.912541 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7076e50-5fd9-4eda-bde1-82ece48781c2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:24.912835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7076e50-5fd9-4eda-bde1-82ece48781c2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:24.913117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7076e50-5fd9-4eda-bde1-82ece48781c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:24.931473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d7076e50-5fd9-4eda-bde1-82ece48781c2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:24.932678 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d7076e50-5fd9-4eda-bde1-82ece48781c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:24.992023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1205/2404] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:08:25.002426 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:25.004180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:25.025902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:25.065318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0a0c-2d2f-443e-9bc2-afde24c06f97 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:25.069022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59259de-1ae0-494a-97f0-fab3ff8bb93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:25.069705 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59259de-1ae0-494a-97f0-fab3ff8bb93e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:25.070001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59259de-1ae0-494a-97f0-fab3ff8bb93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:25.070287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59259de-1ae0-494a-97f0-fab3ff8bb93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:25.079839 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59259de-1ae0-494a-97f0-fab3ff8bb93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:25.081301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59259de-1ae0-494a-97f0-fab3ff8bb93e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:25.091811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1200/2405] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:08:29.964138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49fc8-ea72-4426-84cf-e7860347e465 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:29.968923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49fc8-ea72-4426-84cf-e7860347e465 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:29.969391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49fc8-ea72-4426-84cf-e7860347e465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:30.071088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dff49fc8-ea72-4426-84cf-e7860347e465 None None] MFA Rules not processed for user `64cb61cd1c734fb9abab9fe5860c0eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:30.072931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dff49fc8-ea72-4426-84cf-e7860347e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:30.132204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:30.227130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1206/2406] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:08:30.232838 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59259de-1ae0-494a-97f0-fab3ff8bb93e service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:30.248649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59259de-1ae0-494a-97f0-fab3ff8bb93e service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:30.258797 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa96de-86a7-4785-90cc-cb7d3ba547b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:30.259731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa96de-86a7-4785-90cc-cb7d3ba547b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:30.260060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa96de-86a7-4785-90cc-cb7d3ba547b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:30.260356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa96de-86a7-4785-90cc-cb7d3ba547b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:30.261653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa96de-86a7-4785-90cc-cb7d3ba547b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:30.264621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa96de-86a7-4785-90cc-cb7d3ba547b1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:30.300090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1201/2407] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:08:30 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:08:30.303493 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49fc8-ea72-4426-84cf-e7860347e465 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:30.314570 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49fc8-ea72-4426-84cf-e7860347e465 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:30.379504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e57de9-28a2-4fc4-8619-14445dbb7d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:30.380221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e57de9-28a2-4fc4-8619-14445dbb7d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:30.380559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e57de9-28a2-4fc4-8619-14445dbb7d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:30.380849 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e57de9-28a2-4fc4-8619-14445dbb7d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:30.381578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e57de9-28a2-4fc4-8619-14445dbb7d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:30.384459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e57de9-28a2-4fc4-8619-14445dbb7d2e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:30.427885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1207/2408] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:08:30 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:08:30.430530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa96de-86a7-4785-90cc-cb7d3ba547b1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:30.442898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa96de-86a7-4785-90cc-cb7d3ba547b1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:30.449292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d606-a2a0-4a5f-abb8-66ed1fd6b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:30.450155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d606-a2a0-4a5f-abb8-66ed1fd6b65c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:30.450522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d606-a2a0-4a5f-abb8-66ed1fd6b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:30.450883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d606-a2a0-4a5f-abb8-66ed1fd6b65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:30.451751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d606-a2a0-4a5f-abb8-66ed1fd6b65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:30.454458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d606-a2a0-4a5f-abb8-66ed1fd6b65c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:30.477607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1202/2409] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:08:30.482239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e57de9-28a2-4fc4-8619-14445dbb7d2e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:30.495448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e57de9-28a2-4fc4-8619-14445dbb7d2e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:30.501575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62ee58-5bac-46de-b57a-95884808d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:30.502670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ee58-5bac-46de-b57a-95884808d8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:30.503203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ee58-5bac-46de-b57a-95884808d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:30.503711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ee58-5bac-46de-b57a-95884808d8d8 admin admin] PATH_INFO: `/v3/projects/b2a1e2eb48ad46df9e60ddab5b0ba211/users/0f263cb2ca9b41ccbdc5261f2cf7a4e7/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:30.527847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62ee58-5bac-46de-b57a-95884808d8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a1e2eb48ad46df9e60ddab5b0ba211, user_id=0f263cb2ca9b41ccbdc5261f2cf7a4e7, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:30.532108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62ee58-5bac-46de-b57a-95884808d8d8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:30.562268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1208/2410] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:08:30 2022] PUT /identity/v3/projects/b2a1e2eb48ad46df9e60ddab5b0ba211/users/0f263cb2ca9b41ccbdc5261f2cf7a4e7/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:08:30.563769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d606-a2a0-4a5f-abb8-66ed1fd6b65c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:30.577587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d606-a2a0-4a5f-abb8-66ed1fd6b65c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:30.665057 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160053d2-eaf3-4a04-9b12-1b9bc709c97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:30.666010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160053d2-eaf3-4a04-9b12-1b9bc709c97c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:30.666351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160053d2-eaf3-4a04-9b12-1b9bc709c97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:30.666643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160053d2-eaf3-4a04-9b12-1b9bc709c97c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:30.667430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160053d2-eaf3-4a04-9b12-1b9bc709c97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:30.669739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160053d2-eaf3-4a04-9b12-1b9bc709c97c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:30.681117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1203/2411] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:08:30.685024 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62ee58-5bac-46de-b57a-95884808d8d8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:30.696340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62ee58-5bac-46de-b57a-95884808d8d8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:30.701419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3175761-4407-4bfd-a41f-3ba57b19e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:30.702304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175761-4407-4bfd-a41f-3ba57b19e1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:30.702593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175761-4407-4bfd-a41f-3ba57b19e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:30.702882 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175761-4407-4bfd-a41f-3ba57b19e1ed admin admin] PATH_INFO: `/v3/projects/b2a1e2eb48ad46df9e60ddab5b0ba211/users/0f263cb2ca9b41ccbdc5261f2cf7a4e7/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:30.704919 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3175761-4407-4bfd-a41f-3ba57b19e1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a1e2eb48ad46df9e60ddab5b0ba211, user_id=0f263cb2ca9b41ccbdc5261f2cf7a4e7, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:30.707692 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3175761-4407-4bfd-a41f-3ba57b19e1ed admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:30.719553 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1209/2412] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:08:30 2022] PUT /identity/v3/projects/b2a1e2eb48ad46df9e60ddab5b0ba211/users/0f263cb2ca9b41ccbdc5261f2cf7a4e7/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:08:35.007947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83771bc1-dfaa-47a3-ba20-71b25bdcdf3a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:35.008459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83771bc1-dfaa-47a3-ba20-71b25bdcdf3a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:35.008724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83771bc1-dfaa-47a3-ba20-71b25bdcdf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:35.045702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-83771bc1-dfaa-47a3-ba20-71b25bdcdf3a None None] MFA Rules not processed for user `dcd4aeea3a094122a7c7c6944b96cb71`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:35.049638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-83771bc1-dfaa-47a3-ba20-71b25bdcdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:35.171434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1204/2413] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:08:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:08:36.428156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87dc2b-2042-4232-b952-ea11de724616 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:36.428648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87dc2b-2042-4232-b952-ea11de724616 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:36.428843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87dc2b-2042-4232-b952-ea11de724616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:36.509039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ce87dc2b-2042-4232-b952-ea11de724616 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:36.510609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ce87dc2b-2042-4232-b952-ea11de724616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:36.636009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1210/2414] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:08:36.706079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83771bc1-dfaa-47a3-ba20-71b25bdcdf3a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:36.707687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-83771bc1-dfaa-47a3-ba20-71b25bdcdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:36.773436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6e8cd-79b7-44e9-bb81-61d990370a6d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:36.773767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6e8cd-79b7-44e9-bb81-61d990370a6d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:36.774045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6e8cd-79b7-44e9-bb81-61d990370a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:36.792230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:36.822035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e7d6e8cd-79b7-44e9-bb81-61d990370a6d None None] MFA Rules not processed for user `0f263cb2ca9b41ccbdc5261f2cf7a4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:36.823319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e7d6e8cd-79b7-44e9-bb81-61d990370a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:36.829296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:36.873449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83771bc1-dfaa-47a3-ba20-71b25bdcdf3a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:36.880850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:36.881918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:36.882471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:36.883178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:36.896290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:36.898775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:36.963297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1205/2415] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:08:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:08:36.975706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1211/2416] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:08:36.998471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:37.001686 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:37.255719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae455994-f903-464e-864f-885c33cc06ba service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:37.275099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95fdd3-7176-4e06-b46d-3678c7dab55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:37.276191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95fdd3-7176-4e06-b46d-3678c7dab55b service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:37.276524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95fdd3-7176-4e06-b46d-3678c7dab55b service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:37.276869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95fdd3-7176-4e06-b46d-3678c7dab55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:37.420230 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95fdd3-7176-4e06-b46d-3678c7dab55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:37.421856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95fdd3-7176-4e06-b46d-3678c7dab55b service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:37.444068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1206/2417] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:08:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:08:46.971757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=27 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:47.428566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=74 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:08:58.214088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb757-61fb-42e9-a0f8-4b342401b25e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:58.214560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb757-61fb-42e9-a0f8-4b342401b25e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:58.214656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb757-61fb-42e9-a0f8-4b342401b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:58.232889 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8cbfb757-61fb-42e9-a0f8-4b342401b25e None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:08:58.234124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8cbfb757-61fb-42e9-a0f8-4b342401b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:08:58.241199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1212/2418] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:08:58.253135 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95fdd3-7176-4e06-b46d-3678c7dab55b service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:08:58.265324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95fdd3-7176-4e06-b46d-3678c7dab55b service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:08:58.270641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de738b-7580-4e74-967a-e832058d5178 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:08:58.271297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de738b-7580-4e74-967a-e832058d5178 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:08:58.271589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de738b-7580-4e74-967a-e832058d5178 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:08:58.271873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de738b-7580-4e74-967a-e832058d5178 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:08:58.281229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de738b-7580-4e74-967a-e832058d5178 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:08:58.282878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de738b-7580-4e74-967a-e832058d5178 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:08:58.291170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1207/2419] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:08:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:09:00.285753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6831e-b95e-4d77-b27b-b534185702c9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:00.286265 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6831e-b95e-4d77-b27b-b534185702c9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:00.286362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6831e-b95e-4d77-b27b-b534185702c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:00.304167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ccb6831e-b95e-4d77-b27b-b534185702c9 None None] MFA Rules not processed for user `64cb61cd1c734fb9abab9fe5860c0eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:00.305374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ccb6831e-b95e-4d77-b27b-b534185702c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:00.312353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1213/2420] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:08.287975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:10.299155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:20.815154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b669-51de-4d97-9c7d-7dbf91308a36 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:20.815649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b669-51de-4d97-9c7d-7dbf91308a36 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:20.815829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b669-51de-4d97-9c7d-7dbf91308a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:20.835427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ee93b669-51de-4d97-9c7d-7dbf91308a36 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:20.836911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ee93b669-51de-4d97-9c7d-7dbf91308a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:20.846793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1208/2421] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 8 13:09:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:20.859742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6831e-b95e-4d77-b27b-b534185702c9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:20.871862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6831e-b95e-4d77-b27b-b534185702c9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:20.877719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a512-5137-4103-baeb-fd8be785bfb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:20.878366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a512-5137-4103-baeb-fd8be785bfb1 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:20.878659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a512-5137-4103-baeb-fd8be785bfb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:20.878944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a512-5137-4103-baeb-fd8be785bfb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:20.887122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0a512-5137-4103-baeb-fd8be785bfb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:20.889938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0a512-5137-4103-baeb-fd8be785bfb1 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:20.898241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1214/2422] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:09:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:09:30.830581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:30.894921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:35.738917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93b669-51de-4d97-9c7d-7dbf91308a36 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:35.740367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ee93b669-51de-4d97-9c7d-7dbf91308a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:35.797313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93b669-51de-4d97-9c7d-7dbf91308a36 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:35.800878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:35.801527 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:35.801849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:35.802132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:35.811155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:35.812638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:35.822121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1209/2423] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:44.383029 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a512-5137-4103-baeb-fd8be785bfb1 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:44.392707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a512-5137-4103-baeb-fd8be785bfb1 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:44.396791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:44.397438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:44.397756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:44.398036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:44.399770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:44.463259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:44.464755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:44.475271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1215/2424] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:45.817959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=26 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:47.350673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:47.352231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:47.428051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:47.429810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:47.444906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173e256-f359-424e-bec6-a561d8a43690 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:47.455460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:47.456387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:47.456674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:47.456958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] PATH_INFO: `/v3/users/80ffae178b294666b137bf69233eef46` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:47.466155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddab019-7fd3-4d3a-a9f8-5f68d59f7ec9 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:47.472457 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ffae178b294666b137bf69233eef46)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:47.474923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:47.480179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:47.482005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:47.482322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:47.482606 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:47.484986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:47.497623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:47.500298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:47.514806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1210/2425] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:47.530877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ffae178b294666b137bf69233eef46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.531626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ffae178b294666b137bf69233eef46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.539009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ffae178b294666b137bf69233eef46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.548762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ffae178b294666b137bf69233eef46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.549385 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-851fd420-56f5-47fd-89bf-4b341b6cb728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ffae178b294666b137bf69233eef46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.568038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1216/2426] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:09:47 2022] DELETE /identity/v3/users/80ffae178b294666b137bf69233eef46 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:09:47.737855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:47.749211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536e672-e8f6-44c0-a1d6-f2ebf08c1ebf service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:47.806685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:47.807643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:47.807950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:47.808231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] PATH_INFO: `/v3/projects/74742afebd7540fe9f3c2c23953eb6a7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:47.819475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74742afebd7540fe9f3c2c23953eb6a7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:47.821357 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:47.872940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74742afebd7540fe9f3c2c23953eb6a7', 'request_id': 'req-90add264-482c-420e-84ac-2c925414e282'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.880576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74742afebd7540fe9f3c2c23953eb6a7', 'request_id': 'req-90add264-482c-420e-84ac-2c925414e282'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.886156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74742afebd7540fe9f3c2c23953eb6a7', 'request_id': 'req-90add264-482c-420e-84ac-2c925414e282'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.898069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] The token cache is being invalidate because project 74742afebd7540fe9f3c2c23953eb6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:09:47.898359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.899009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-90add264-482c-420e-84ac-2c925414e282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:47.900553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1211/2427] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:09:47 2022] DELETE /identity/v3/projects/74742afebd7540fe9f3c2c23953eb6a7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:47.906159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205715e5-4577-4397-be6b-e872670ef135 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:47.906466 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205715e5-4577-4397-be6b-e872670ef135 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:47.906744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205715e5-4577-4397-be6b-e872670ef135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:47.925145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-205715e5-4577-4397-be6b-e872670ef135 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:47.926369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-205715e5-4577-4397-be6b-e872670ef135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:47.974710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:47.988114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1217/2428] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:47.996803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af723a-3a69-4956-af49-7cb44a9609aa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:47.997126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af723a-3a69-4956-af49-7cb44a9609aa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:47.997435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af723a-3a69-4956-af49-7cb44a9609aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.015625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-56af723a-3a69-4956-af49-7cb44a9609aa None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:48.016870 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-56af723a-3a69-4956-af49-7cb44a9609aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:48.024833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1212/2429] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:48.028920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205715e5-4577-4397-be6b-e872670ef135 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.039313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205715e5-4577-4397-be6b-e872670ef135 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.043918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.044573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.044891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.045175 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.045938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:09:48.046317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.047978 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.059521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1218/2430] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:09:48.063750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af723a-3a69-4956-af49-7cb44a9609aa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.069371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:48.073596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af723a-3a69-4956-af49-7cb44a9609aa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.080305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4ca84-ac90-4939-a3a6-a7ee353aa712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.081202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4ca84-ac90-4939-a3a6-a7ee353aa712 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.081819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4ca84-ac90-4939-a3a6-a7ee353aa712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.082117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4ca84-ac90-4939-a3a6-a7ee353aa712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.082901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4ca84-ac90-4939-a3a6-a7ee353aa712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.085042 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4ca84-ac90-4939-a3a6-a7ee353aa712 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.111061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1213/2431] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:09:48 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:09:48.115188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.125745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faf528-cfd8-4ab0-bc80-4cfcf6409e78 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.182100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b6b2-0f41-42db-ac46-2b30369d4eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.182773 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b6b2-0f41-42db-ac46-2b30369d4eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.183063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b6b2-0f41-42db-ac46-2b30369d4eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.183345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b6b2-0f41-42db-ac46-2b30369d4eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.184046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b6b2-0f41-42db-ac46-2b30369d4eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.186048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b6b2-0f41-42db-ac46-2b30369d4eb3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.211522 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1219/2432] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:09:48 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:09:48.215659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4ca84-ac90-4939-a3a6-a7ee353aa712 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.226418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4ca84-ac90-4939-a3a6-a7ee353aa712 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.231185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c0b03-7f20-43c5-a9c9-41857ae80003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.231924 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0b03-7f20-43c5-a9c9-41857ae80003 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.232220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0b03-7f20-43c5-a9c9-41857ae80003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.232521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0b03-7f20-43c5-a9c9-41857ae80003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.233235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c0b03-7f20-43c5-a9c9-41857ae80003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.235439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c0b03-7f20-43c5-a9c9-41857ae80003 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.245600 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1214/2433] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:48.249810 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b6b2-0f41-42db-ac46-2b30369d4eb3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.260332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b6b2-0f41-42db-ac46-2b30369d4eb3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.265030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab2bf9-b6c7-48de-8eba-bbefe6ee8d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.265905 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2bf9-b6c7-48de-8eba-bbefe6ee8d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.266197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2bf9-b6c7-48de-8eba-bbefe6ee8d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.266483 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2bf9-b6c7-48de-8eba-bbefe6ee8d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.267210 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab2bf9-b6c7-48de-8eba-bbefe6ee8d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.268799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab2bf9-b6c7-48de-8eba-bbefe6ee8d74 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.279078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1220/2434] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:48.283404 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c0b03-7f20-43c5-a9c9-41857ae80003 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.293300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c0b03-7f20-43c5-a9c9-41857ae80003 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.298655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.299531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.299818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.300099 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] PATH_INFO: `/v3/projects/6177f2d5581549dc9ea02900365f53e4/users/cbef21086f2d4ba3b2bc83de65074178/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.316307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6177f2d5581549dc9ea02900365f53e4, user_id=cbef21086f2d4ba3b2bc83de65074178, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.319018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.331747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1215/2435] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:09:48 2022] PUT /identity/v3/projects/6177f2d5581549dc9ea02900365f53e4/users/cbef21086f2d4ba3b2bc83de65074178/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:48.341589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb58a1-ebb5-4e14-a1f0-7396ff420e48 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.341890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb58a1-ebb5-4e14-a1f0-7396ff420e48 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.342177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb58a1-ebb5-4e14-a1f0-7396ff420e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.369503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d8cb58a1-ebb5-4e14-a1f0-7396ff420e48 None None] MFA Rules not processed for user `cbef21086f2d4ba3b2bc83de65074178`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:48.370834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d8cb58a1-ebb5-4e14-a1f0-7396ff420e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:48.435446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1221/2436] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:48.447062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.448849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:48.521410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22057998-f7dc-46b2-9b77-9bd3197e94c7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.527046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.527697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.527990 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.528277 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.537018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.538639 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.548045 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1216/2437] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:48.622263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb58a1-ebb5-4e14-a1f0-7396ff420e48 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.623714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d8cb58a1-ebb5-4e14-a1f0-7396ff420e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:48.679665 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb58a1-ebb5-4e14-a1f0-7396ff420e48 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.683260 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.683899 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.684184 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.684462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.686241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:48.696042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:48.700686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.702437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.713974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1222/2438] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:48.783863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.785264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:48.797503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df4bbe-7d43-418c-bcaa-8577c071b1a0 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.801153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b936d-7bd7-463f-b8d3-5e99729981f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.801829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b936d-7bd7-463f-b8d3-5e99729981f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.802120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b936d-7bd7-463f-b8d3-5e99729981f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.802403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b936d-7bd7-463f-b8d3-5e99729981f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.804142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-077b936d-7bd7-463f-b8d3-5e99729981f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:48.817244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b936d-7bd7-463f-b8d3-5e99729981f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.818724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b936d-7bd7-463f-b8d3-5e99729981f1 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:48.830116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1217/2439] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:09:48.907472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:48.967816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d6e56-9a13-424c-93d2-5b8fe107bf7d service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:48.973139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:48.974040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:48.974328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:48.974609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] PATH_INFO: `/v3/users/cbef21086f2d4ba3b2bc83de65074178` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:48.975791 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbef21086f2d4ba3b2bc83de65074178)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:48.977821 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:49.030105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbef21086f2d4ba3b2bc83de65074178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.031568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbef21086f2d4ba3b2bc83de65074178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.040407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbef21086f2d4ba3b2bc83de65074178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.048065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbef21086f2d4ba3b2bc83de65074178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.048942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbef21086f2d4ba3b2bc83de65074178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.067088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1223/2440] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:09:48 2022] DELETE /identity/v3/users/cbef21086f2d4ba3b2bc83de65074178 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:09:49.071775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c45a2-6205-46d6-8ce0-ce3b57becd0a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.072149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c45a2-6205-46d6-8ce0-ce3b57becd0a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.072613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c45a2-6205-46d6-8ce0-ce3b57becd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.090922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b50c45a2-6205-46d6-8ce0-ce3b57becd0a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:49.092039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b50c45a2-6205-46d6-8ce0-ce3b57becd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:49.150009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1218/2441] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:49.159687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:49.161153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:49.219086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51a57a-d808-405f-a378-e9f4f49e3f1e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:49.222890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3d6c4-037f-4fec-aa43-5e8591d3384c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:49.223543 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d6c4-037f-4fec-aa43-5e8591d3384c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.223831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d6c4-037f-4fec-aa43-5e8591d3384c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.224113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d6c4-037f-4fec-aa43-5e8591d3384c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.233072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3d6c4-037f-4fec-aa43-5e8591d3384c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:49.234611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3d6c4-037f-4fec-aa43-5e8591d3384c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:49.244346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1224/2442] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:49.523140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c45a2-6205-46d6-8ce0-ce3b57becd0a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:49.524703 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b50c45a2-6205-46d6-8ce0-ce3b57becd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:49.542721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c45a2-6205-46d6-8ce0-ce3b57becd0a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:49.553271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:49.554087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.554361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.554645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] PATH_INFO: `/v3/projects/6177f2d5581549dc9ea02900365f53e4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.555853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6177f2d5581549dc9ea02900365f53e4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:49.557987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:49.574641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:49.610910 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6177f2d5581549dc9ea02900365f53e4', 'request_id': 'req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.618338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6177f2d5581549dc9ea02900365f53e4', 'request_id': 'req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.624359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6177f2d5581549dc9ea02900365f53e4', 'request_id': 'req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.636027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] The token cache is being invalidate because project 6177f2d5581549dc9ea02900365f53e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:09:49.636318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.636947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b4d6ba-7297-4978-bdfa-1a6ac2cdf621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:49.638530 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1219/2443] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:09:49 2022] DELETE /identity/v3/projects/6177f2d5581549dc9ea02900365f53e4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:49.643527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb77c-f587-43c5-9f7a-4345ef989141 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.643986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb77c-f587-43c5-9f7a-4345ef989141 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.644101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb77c-f587-43c5-9f7a-4345ef989141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.661961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8a3eb77c-f587-43c5-9f7a-4345ef989141 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:49.663172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8a3eb77c-f587-43c5-9f7a-4345ef989141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:49.674141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:49.725780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1225/2444] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:49.733457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8066fa6-a9c8-48f1-9782-445d2d52a1cc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.733897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8066fa6-a9c8-48f1-9782-445d2d52a1cc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.734282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8066fa6-a9c8-48f1-9782-445d2d52a1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.752708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f8066fa6-a9c8-48f1-9782-445d2d52a1cc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:49.753952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f8066fa6-a9c8-48f1-9782-445d2d52a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:49.761862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1220/2445] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:49.766719 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3eb77c-f587-43c5-9f7a-4345ef989141 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:49.776545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3eb77c-f587-43c5-9f7a-4345ef989141 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:49.782042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:49.782710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.782998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.783282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.784040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:09:49.784352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:49.786015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:49.797834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1226/2446] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:09:49.802018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8066fa6-a9c8-48f1-9782-445d2d52a1cc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:49.811433 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8066fa6-a9c8-48f1-9782-445d2d52a1cc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:49.816677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164fb5-f7b5-4bb0-8cc0-00bf26ae5a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:49.817329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164fb5-f7b5-4bb0-8cc0-00bf26ae5a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.817654 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164fb5-f7b5-4bb0-8cc0-00bf26ae5a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.817941 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164fb5-f7b5-4bb0-8cc0-00bf26ae5a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.818631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe164fb5-f7b5-4bb0-8cc0-00bf26ae5a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:49.820551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe164fb5-f7b5-4bb0-8cc0-00bf26ae5a14 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:49.845688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1221/2447] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:09:49 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:09:49.849750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:49.859730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa842fe-675e-4b7b-98a7-71a90607dc62 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:49.922224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70691e2-e71e-4825-b35b-e41e25b4eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:49.922815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70691e2-e71e-4825-b35b-e41e25b4eee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.923102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70691e2-e71e-4825-b35b-e41e25b4eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.923382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70691e2-e71e-4825-b35b-e41e25b4eee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.924107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70691e2-e71e-4825-b35b-e41e25b4eee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:49.926129 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70691e2-e71e-4825-b35b-e41e25b4eee5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:49.944958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1227/2448] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:09:49 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:09:49.949322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164fb5-f7b5-4bb0-8cc0-00bf26ae5a14 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:49.960078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164fb5-f7b5-4bb0-8cc0-00bf26ae5a14 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:49.964678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b57240-d5c2-459a-95ae-01b79f7864f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:49.965335 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57240-d5c2-459a-95ae-01b79f7864f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.965650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57240-d5c2-459a-95ae-01b79f7864f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.965947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57240-d5c2-459a-95ae-01b79f7864f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:49.966655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b57240-d5c2-459a-95ae-01b79f7864f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:49.968311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b57240-d5c2-459a-95ae-01b79f7864f0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:49.978661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1222/2449] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:49.982618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70691e2-e71e-4825-b35b-e41e25b4eee5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:49.992607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70691e2-e71e-4825-b35b-e41e25b4eee5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:49.997658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0d796-c033-4f1e-a61b-ba4067969e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:49.998322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0d796-c033-4f1e-a61b-ba4067969e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:49.998634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0d796-c033-4f1e-a61b-ba4067969e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:49.998915 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0d796-c033-4f1e-a61b-ba4067969e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.000283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0d796-c033-4f1e-a61b-ba4067969e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.001926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0d796-c033-4f1e-a61b-ba4067969e87 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.011963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1228/2450] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:09:50.016594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b57240-d5c2-459a-95ae-01b79f7864f0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:50.026420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b57240-d5c2-459a-95ae-01b79f7864f0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:50.031165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fdb5f-72a3-4980-b776-91d7c145fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:50.032027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fdb5f-72a3-4980-b776-91d7c145fa49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.032312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fdb5f-72a3-4980-b776-91d7c145fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.032592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fdb5f-72a3-4980-b776-91d7c145fa49 admin admin] PATH_INFO: `/v3/projects/509da0a33faf444a89bf914e69259bb4/users/3b0f558aa77041d4adea8b5895b60c7b/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.046792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fdb5f-72a3-4980-b776-91d7c145fa49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509da0a33faf444a89bf914e69259bb4, user_id=3b0f558aa77041d4adea8b5895b60c7b, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.049432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fdb5f-72a3-4980-b776-91d7c145fa49 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.062970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1223/2451] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:09:50 2022] PUT /identity/v3/projects/509da0a33faf444a89bf914e69259bb4/users/3b0f558aa77041d4adea8b5895b60c7b/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:50.074449 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88514605-fd1f-4cbf-957c-138de82701ce None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.074817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88514605-fd1f-4cbf-957c-138de82701ce None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.075197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88514605-fd1f-4cbf-957c-138de82701ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.101878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-88514605-fd1f-4cbf-957c-138de82701ce None None] MFA Rules not processed for user `3b0f558aa77041d4adea8b5895b60c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:50.103082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-88514605-fd1f-4cbf-957c-138de82701ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:50.165959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1229/2452] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:09:50.170423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fdb5f-72a3-4980-b776-91d7c145fa49 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:50.240601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fdb5f-72a3-4980-b776-91d7c145fa49 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:50.245471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f072d5-cc10-4c63-8fbf-74b7985185f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:50.246167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f072d5-cc10-4c63-8fbf-74b7985185f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.246457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f072d5-cc10-4c63-8fbf-74b7985185f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.246747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f072d5-cc10-4c63-8fbf-74b7985185f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.247451 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f072d5-cc10-4c63-8fbf-74b7985185f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.249427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f072d5-cc10-4c63-8fbf-74b7985185f2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.275225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1224/2453] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:09:50 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:09:50.279113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88514605-fd1f-4cbf-957c-138de82701ce None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:50.290002 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88514605-fd1f-4cbf-957c-138de82701ce None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:50.298885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:50.347169 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f9bb5-0ad8-40b4-9ef5-28d01bbf2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:50.347831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9bb5-0ad8-40b4-9ef5-28d01bbf2a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.348118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9bb5-0ad8-40b4-9ef5-28d01bbf2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.348396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9bb5-0ad8-40b4-9ef5-28d01bbf2a13 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.349083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f9bb5-0ad8-40b4-9ef5-28d01bbf2a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.351009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f9bb5-0ad8-40b4-9ef5-28d01bbf2a13 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.372279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1230/2454] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:09:50 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:09:50.377210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f072d5-cc10-4c63-8fbf-74b7985185f2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:50.387728 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f072d5-cc10-4c63-8fbf-74b7985185f2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:50.392709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be489ef-d0a9-4f5a-a255-51d6e8458848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:50.393424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be489ef-d0a9-4f5a-a255-51d6e8458848 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.393749 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be489ef-d0a9-4f5a-a255-51d6e8458848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.394035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be489ef-d0a9-4f5a-a255-51d6e8458848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.394774 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be489ef-d0a9-4f5a-a255-51d6e8458848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.396424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be489ef-d0a9-4f5a-a255-51d6e8458848 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.407937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1225/2455] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:50.412471 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f9bb5-0ad8-40b4-9ef5-28d01bbf2a13 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:50.422767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f9bb5-0ad8-40b4-9ef5-28d01bbf2a13 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:50.427464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99c9e-a365-4cdd-b60c-3e76a571727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:50.428360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99c9e-a365-4cdd-b60c-3e76a571727e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.428648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99c9e-a365-4cdd-b60c-3e76a571727e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.428930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99c9e-a365-4cdd-b60c-3e76a571727e admin admin] PATH_INFO: `/v3/projects/168fa113ed9f45efb372ee2db886a555/users/94d600d168754d5ca2d61c73778e38cb/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.444456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb99c9e-a365-4cdd-b60c-3e76a571727e admin admin] RBAC: Authorizing `identity:create_grant(project_id=168fa113ed9f45efb372ee2db886a555, user_id=94d600d168754d5ca2d61c73778e38cb, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.447176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb99c9e-a365-4cdd-b60c-3e76a571727e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.460365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1231/2456] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:09:50 2022] PUT /identity/v3/projects/168fa113ed9f45efb372ee2db886a555/users/94d600d168754d5ca2d61c73778e38cb/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:50.464316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be489ef-d0a9-4f5a-a255-51d6e8458848 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:50.474783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be489ef-d0a9-4f5a-a255-51d6e8458848 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:50.485231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:50.533125 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729858d8-372a-4dca-ba93-577f80fdb216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:50.533779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729858d8-372a-4dca-ba93-577f80fdb216 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.534028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729858d8-372a-4dca-ba93-577f80fdb216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.534305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729858d8-372a-4dca-ba93-577f80fdb216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.535022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729858d8-372a-4dca-ba93-577f80fdb216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.536609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729858d8-372a-4dca-ba93-577f80fdb216 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.546818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1226/2457] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:50.550991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99c9e-a365-4cdd-b60c-3e76a571727e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:50.561072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99c9e-a365-4cdd-b60c-3e76a571727e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:50.566701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:50.567590 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.567887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.568163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] PATH_INFO: `/v3/projects/168fa113ed9f45efb372ee2db886a555/users/94d600d168754d5ca2d61c73778e38cb/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.570199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168fa113ed9f45efb372ee2db886a555, user_id=94d600d168754d5ca2d61c73778e38cb, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.572863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.583391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1232/2458] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:09:50 2022] PUT /identity/v3/projects/168fa113ed9f45efb372ee2db886a555/users/94d600d168754d5ca2d61c73778e38cb/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:50.593592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca1623-c9f1-4588-ab45-53ae1847ec01 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.593893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca1623-c9f1-4588-ab45-53ae1847ec01 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.594182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca1623-c9f1-4588-ab45-53ae1847ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.620903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2dca1623-c9f1-4588-ab45-53ae1847ec01 None None] MFA Rules not processed for user `94d600d168754d5ca2d61c73778e38cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:50.622133 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2dca1623-c9f1-4588-ab45-53ae1847ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:50.689009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1227/2459] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:50.700319 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:50.702088 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:50.758125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e070a0-2fb1-4891-961d-5ae095230ad5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:50.761780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf8d1-aabb-4469-8c40-22c915c08640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:50.762418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf8d1-aabb-4469-8c40-22c915c08640 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:50.762705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf8d1-aabb-4469-8c40-22c915c08640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:50.762994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf8d1-aabb-4469-8c40-22c915c08640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:50.771985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf8d1-aabb-4469-8c40-22c915c08640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:50.773413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf8d1-aabb-4469-8c40-22c915c08640 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:50.783370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1233/2460] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:51.178410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca1623-c9f1-4588-ab45-53ae1847ec01 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:51.242212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca1623-c9f1-4588-ab45-53ae1847ec01 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:51.246930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:51.247798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:51.248088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:51.248376 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] PATH_INFO: `/v3/users/3b0f558aa77041d4adea8b5895b60c7b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:51.250303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0f558aa77041d4adea8b5895b60c7b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:51.252263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:51.290518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:51.300199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0f558aa77041d4adea8b5895b60c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.300869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0f558aa77041d4adea8b5895b60c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.308244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0f558aa77041d4adea8b5895b60c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.320837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0f558aa77041d4adea8b5895b60c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.328190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0f558aa77041d4adea8b5895b60c7b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.334262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1228/2461] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:09:51 2022] DELETE /identity/v3/users/3b0f558aa77041d4adea8b5895b60c7b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:51.338758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c748e-5450-47c5-a0fd-94fc5cc724da None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:51.339061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c748e-5450-47c5-a0fd-94fc5cc724da None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:51.339349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c748e-5450-47c5-a0fd-94fc5cc724da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:51.357055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-907c748e-5450-47c5-a0fd-94fc5cc724da None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:51.358305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-907c748e-5450-47c5-a0fd-94fc5cc724da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:51.419311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1234/2462] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:09:51.428786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:51.430275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:51.488637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa878fc-d16f-4502-a3af-fc3b080f0662 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:51.492389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2425c4-6939-41be-b2a5-98366dccc7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:51.493233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2425c4-6939-41be-b2a5-98366dccc7ba service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:51.493597 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2425c4-6939-41be-b2a5-98366dccc7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:51.493815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2425c4-6939-41be-b2a5-98366dccc7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:51.504692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2425c4-6939-41be-b2a5-98366dccc7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:51.506185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2425c4-6939-41be-b2a5-98366dccc7ba service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:51.515747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1229/2463] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:51.785946 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c748e-5450-47c5-a0fd-94fc5cc724da None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:51.787426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-907c748e-5450-47c5-a0fd-94fc5cc724da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:51.802916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c748e-5450-47c5-a0fd-94fc5cc724da None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:51.807722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:51.808586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:51.808950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:51.809132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] PATH_INFO: `/v3/projects/509da0a33faf444a89bf914e69259bb4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:51.810886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509da0a33faf444a89bf914e69259bb4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:51.812771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:51.814407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:51.863914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509da0a33faf444a89bf914e69259bb4', 'request_id': 'req-a4418b89-6615-459b-bae1-2e0058662168'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.870271 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509da0a33faf444a89bf914e69259bb4', 'request_id': 'req-a4418b89-6615-459b-bae1-2e0058662168'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.878285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509da0a33faf444a89bf914e69259bb4', 'request_id': 'req-a4418b89-6615-459b-bae1-2e0058662168'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.888664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] The token cache is being invalidate because project 509da0a33faf444a89bf914e69259bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:09:51.888956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.889616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:51.891865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1235/2464] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:09:51 2022] DELETE /identity/v3/projects/509da0a33faf444a89bf914e69259bb4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:51.895810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2425c4-6939-41be-b2a5-98366dccc7ba service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:51.906274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2425c4-6939-41be-b2a5-98366dccc7ba service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:51.962341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:51.963218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:51.963508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:51.963792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] PATH_INFO: `/v3/users/94d600d168754d5ca2d61c73778e38cb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:51.964973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d600d168754d5ca2d61c73778e38cb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:51.966953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:52.012059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d600d168754d5ca2d61c73778e38cb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.012719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d600d168754d5ca2d61c73778e38cb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.020565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d600d168754d5ca2d61c73778e38cb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.025311 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:52.036465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d600d168754d5ca2d61c73778e38cb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.043747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88f9ede9-bad3-41e2-8e12-cedefb252b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d600d168754d5ca2d61c73778e38cb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.051304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1230/2465] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:09:51 2022] DELETE /identity/v3/users/94d600d168754d5ca2d61c73778e38cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:52.327391 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:52.329436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:52.342539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418b89-6615-459b-bae1-2e0058662168 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:52.401282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:52.402112 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.402399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.402674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] PATH_INFO: `/v3/projects/168fa113ed9f45efb372ee2db886a555` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.403852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=168fa113ed9f45efb372ee2db886a555)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:52.405805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:52.452660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168fa113ed9f45efb372ee2db886a555', 'request_id': 'req-8928d917-b4b2-4926-a93c-c63952fd85f0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.458954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168fa113ed9f45efb372ee2db886a555', 'request_id': 'req-8928d917-b4b2-4926-a93c-c63952fd85f0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.466693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168fa113ed9f45efb372ee2db886a555', 'request_id': 'req-8928d917-b4b2-4926-a93c-c63952fd85f0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.477706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] The token cache is being invalidate because project 168fa113ed9f45efb372ee2db886a555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:09:52.477999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.478639 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8928d917-b4b2-4926-a93c-c63952fd85f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:09:52.480191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1236/2466] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:09:52 2022] DELETE /identity/v3/projects/168fa113ed9f45efb372ee2db886a555 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:52.486014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf24b-6e1e-4477-abe9-177884f96ba6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.486429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf24b-6e1e-4477-abe9-177884f96ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.486719 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedf24b-6e1e-4477-abe9-177884f96ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.504995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dbedf24b-6e1e-4477-abe9-177884f96ba6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:52.506233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbedf24b-6e1e-4477-abe9-177884f96ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:52.564529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1231/2467] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:52.572308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744beef-0631-4238-8bad-fac2797203ce None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.572636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744beef-0631-4238-8bad-fac2797203ce None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.572934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744beef-0631-4238-8bad-fac2797203ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.591091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5744beef-0631-4238-8bad-fac2797203ce None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:52.592293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5744beef-0631-4238-8bad-fac2797203ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:52.600160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1237/2468] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:52.604221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedf24b-6e1e-4477-abe9-177884f96ba6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:52.615093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedf24b-6e1e-4477-abe9-177884f96ba6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:52.620043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:52.620701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.620991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.621275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.622055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:09:52.622365 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:52.623970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:52.636592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1232/2469] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:09:52.640730 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744beef-0631-4238-8bad-fac2797203ce None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:52.650121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744beef-0631-4238-8bad-fac2797203ce None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:52.654944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1191d6-21f9-4093-b35b-af744a5d6b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:52.655604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1191d6-21f9-4093-b35b-af744a5d6b02 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.656004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1191d6-21f9-4093-b35b-af744a5d6b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.656295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1191d6-21f9-4093-b35b-af744a5d6b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.657022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1191d6-21f9-4093-b35b-af744a5d6b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:52.658951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1191d6-21f9-4093-b35b-af744a5d6b02 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:52.668670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:52.686490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1238/2470] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:09:52 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:09:52.691389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:52.701681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0291b2-feec-43d6-aa42-3d83ae267fb0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:52.758803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229e2be-0e1a-4d7a-9f21-8a74293924bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:52.759479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e2be-0e1a-4d7a-9f21-8a74293924bf admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.759773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e2be-0e1a-4d7a-9f21-8a74293924bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.760060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e2be-0e1a-4d7a-9f21-8a74293924bf admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.760759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229e2be-0e1a-4d7a-9f21-8a74293924bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:52.762730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229e2be-0e1a-4d7a-9f21-8a74293924bf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:52.783143 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1233/2471] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:09:52 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:09:52.787297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1191d6-21f9-4093-b35b-af744a5d6b02 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:52.798450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1191d6-21f9-4093-b35b-af744a5d6b02 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:52.803172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cb5fd-e873-4a8e-b3e5-1be5d13d5fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:52.803835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cb5fd-e873-4a8e-b3e5-1be5d13d5fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.804145 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cb5fd-e873-4a8e-b3e5-1be5d13d5fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.804424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cb5fd-e873-4a8e-b3e5-1be5d13d5fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.805180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cb5fd-e873-4a8e-b3e5-1be5d13d5fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:52.806840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cb5fd-e873-4a8e-b3e5-1be5d13d5fc4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:52.817762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1239/2472] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:52.821441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229e2be-0e1a-4d7a-9f21-8a74293924bf admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:52.831395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229e2be-0e1a-4d7a-9f21-8a74293924bf admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:52.835983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f3c73-947f-4256-bb3b-9f45841efe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:52.836637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3c73-947f-4256-bb3b-9f45841efe33 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.836922 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3c73-947f-4256-bb3b-9f45841efe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.837199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3c73-947f-4256-bb3b-9f45841efe33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.837956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f3c73-947f-4256-bb3b-9f45841efe33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:52.839538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f3c73-947f-4256-bb3b-9f45841efe33 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:52.849821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1234/2473] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:52.853702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cb5fd-e873-4a8e-b3e5-1be5d13d5fc4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:52.864695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cb5fd-e873-4a8e-b3e5-1be5d13d5fc4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:52.869684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce8d1-8905-4d6d-bd4b-4c75f6e07b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:52.870567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce8d1-8905-4d6d-bd4b-4c75f6e07b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.870861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce8d1-8905-4d6d-bd4b-4c75f6e07b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.871140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce8d1-8905-4d6d-bd4b-4c75f6e07b65 admin admin] PATH_INFO: `/v3/projects/9fb39559eb894ebd97df2bd205e1d004/users/d31862f266334588b4cd31a29ae722ca/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.885997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cce8d1-8905-4d6d-bd4b-4c75f6e07b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb39559eb894ebd97df2bd205e1d004, user_id=d31862f266334588b4cd31a29ae722ca, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:52.888676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cce8d1-8905-4d6d-bd4b-4c75f6e07b65 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:52.903219 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1240/2474] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:09:52 2022] PUT /identity/v3/projects/9fb39559eb894ebd97df2bd205e1d004/users/d31862f266334588b4cd31a29ae722ca/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:52.914960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f80b8-0cb4-469e-b434-20a6f11ad785 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:52.915441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f80b8-0cb4-469e-b434-20a6f11ad785 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:52.915540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f80b8-0cb4-469e-b434-20a6f11ad785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:52.942761 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1b2f80b8-0cb4-469e-b434-20a6f11ad785 None None] MFA Rules not processed for user `d31862f266334588b4cd31a29ae722ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:52.943976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1b2f80b8-0cb4-469e-b434-20a6f11ad785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:52.974228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:53.011403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1235/2475] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:53.016018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce8d1-8905-4d6d-bd4b-4c75f6e07b65 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:53.076491 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce8d1-8905-4d6d-bd4b-4c75f6e07b65 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:53.081141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b3f28-4a9a-4a54-a081-b9342b983c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:53.081833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3f28-4a9a-4a54-a081-b9342b983c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:53.082116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3f28-4a9a-4a54-a081-b9342b983c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:53.082394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3f28-4a9a-4a54-a081-b9342b983c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:53.083077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b3f28-4a9a-4a54-a081-b9342b983c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:53.084955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b3f28-4a9a-4a54-a081-b9342b983c3c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:53.113074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1241/2476] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:09:53 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:09:53.117115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f80b8-0cb4-469e-b434-20a6f11ad785 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:53.128612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f80b8-0cb4-469e-b434-20a6f11ad785 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:53.185272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96716e44-8d82-4dae-bc89-7635ff513998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:53.185909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96716e44-8d82-4dae-bc89-7635ff513998 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:53.186202 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96716e44-8d82-4dae-bc89-7635ff513998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:53.186486 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96716e44-8d82-4dae-bc89-7635ff513998 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:53.187892 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96716e44-8d82-4dae-bc89-7635ff513998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:53.190453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96716e44-8d82-4dae-bc89-7635ff513998 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:53.212637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1236/2477] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:09:53 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:09:53.214036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b3f28-4a9a-4a54-a081-b9342b983c3c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:53.224458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b3f28-4a9a-4a54-a081-b9342b983c3c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:53.229162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6078480-d9f9-45e2-a1eb-cc97877bf1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:53.229869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6078480-d9f9-45e2-a1eb-cc97877bf1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:53.230159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6078480-d9f9-45e2-a1eb-cc97877bf1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:53.230446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6078480-d9f9-45e2-a1eb-cc97877bf1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:53.231177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6078480-d9f9-45e2-a1eb-cc97877bf1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:53.232984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6078480-d9f9-45e2-a1eb-cc97877bf1f6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:53.246028 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1242/2478] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:53.250833 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96716e44-8d82-4dae-bc89-7635ff513998 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:53.260801 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96716e44-8d82-4dae-bc89-7635ff513998 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:53.265711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9854b1-e147-47a6-b443-4dacd3743a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:53.266588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9854b1-e147-47a6-b443-4dacd3743a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:53.266903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9854b1-e147-47a6-b443-4dacd3743a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:53.267186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9854b1-e147-47a6-b443-4dacd3743a4f admin admin] PATH_INFO: `/v3/projects/d574c9b8e7cd43fc8646782db5662e86/users/83899dae88034d3689e210a25408a15c/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:53.282118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9854b1-e147-47a6-b443-4dacd3743a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d574c9b8e7cd43fc8646782db5662e86, user_id=83899dae88034d3689e210a25408a15c, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:53.284767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9854b1-e147-47a6-b443-4dacd3743a4f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:53.297919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1237/2479] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:09:53 2022] PUT /identity/v3/projects/d574c9b8e7cd43fc8646782db5662e86/users/83899dae88034d3689e210a25408a15c/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:09:53.301866 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6078480-d9f9-45e2-a1eb-cc97877bf1f6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:53.312760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6078480-d9f9-45e2-a1eb-cc97877bf1f6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:53.368322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b54e2a-3437-4e08-b3e7-cfc89056589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:53.368993 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54e2a-3437-4e08-b3e7-cfc89056589e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:53.369536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54e2a-3437-4e08-b3e7-cfc89056589e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:53.369851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54e2a-3437-4e08-b3e7-cfc89056589e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:53.370581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b54e2a-3437-4e08-b3e7-cfc89056589e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:53.372224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b54e2a-3437-4e08-b3e7-cfc89056589e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:53.383258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1243/2480] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:09:53.387507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9854b1-e147-47a6-b443-4dacd3743a4f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:53.399234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9854b1-e147-47a6-b443-4dacd3743a4f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:53.403966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:53.404858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:53.405149 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:53.405436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] PATH_INFO: `/v3/projects/d574c9b8e7cd43fc8646782db5662e86/users/83899dae88034d3689e210a25408a15c/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:53.407632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d574c9b8e7cd43fc8646782db5662e86, user_id=83899dae88034d3689e210a25408a15c, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:53.410337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:53.420729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1238/2481] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:09:53 2022] PUT /identity/v3/projects/d574c9b8e7cd43fc8646782db5662e86/users/83899dae88034d3689e210a25408a15c/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:09:53.431223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0a96-55d6-4e5e-8835-0490f2b9f766 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:53.431521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0a96-55d6-4e5e-8835-0490f2b9f766 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:53.431812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0a96-55d6-4e5e-8835-0490f2b9f766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:53.457987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bfdb0a96-55d6-4e5e-8835-0490f2b9f766 None None] MFA Rules not processed for user `83899dae88034d3689e210a25408a15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:09:53.459099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bfdb0a96-55d6-4e5e-8835-0490f2b9f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:53.471670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:53.528623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1244/2482] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:09:53.539372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:53.541087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:53.601329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be98c5c-7665-4f63-a9f9-284f7e0fdaef admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:53.605051 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face97c6-5d0e-47c4-8024-98da9af30880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:53.605738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face97c6-5d0e-47c4-8024-98da9af30880 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:53.606029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face97c6-5d0e-47c4-8024-98da9af30880 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:53.606305 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face97c6-5d0e-47c4-8024-98da9af30880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:53.644807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:09:53.664763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face97c6-5d0e-47c4-8024-98da9af30880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:53.666247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face97c6-5d0e-47c4-8024-98da9af30880 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:53.675867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1239/2483] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:09:57.854936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0a96-55d6-4e5e-8835-0490f2b9f766 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:09:57.856393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bfdb0a96-55d6-4e5e-8835-0490f2b9f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:09:57.869750 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0a96-55d6-4e5e-8835-0490f2b9f766 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:09:57.873273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03db70-4b67-494c-8e29-0154f89ddc67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:09:57.874031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03db70-4b67-494c-8e29-0154f89ddc67 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:09:57.874321 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03db70-4b67-494c-8e29-0154f89ddc67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:09:57.874600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03db70-4b67-494c-8e29-0154f89ddc67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:09:57.884572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03db70-4b67-494c-8e29-0154f89ddc67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:09:57.886061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03db70-4b67-494c-8e29-0154f89ddc67 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:09:57.895887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1245/2484] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:09:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:02.759607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face97c6-5d0e-47c4-8024-98da9af30880 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:02.820567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face97c6-5d0e-47c4-8024-98da9af30880 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:02.825029 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:02.825929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:02.826214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:02.826493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] PATH_INFO: `/v3/users/d31862f266334588b4cd31a29ae722ca` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:02.827658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31862f266334588b4cd31a29ae722ca)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:02.829850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:02.876302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31862f266334588b4cd31a29ae722ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:02.877070 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31862f266334588b4cd31a29ae722ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:02.904427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31862f266334588b4cd31a29ae722ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:02.921082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31862f266334588b4cd31a29ae722ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:02.929857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31862f266334588b4cd31a29ae722ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:02.947756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1240/2485] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:02 2022] DELETE /identity/v3/users/d31862f266334588b4cd31a29ae722ca => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:02.952409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d3e13-002d-436b-a6c0-d8e4bf067043 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:02.952858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d3e13-002d-436b-a6c0-d8e4bf067043 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:02.953499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d3e13-002d-436b-a6c0-d8e4bf067043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:02.972475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fc6d3e13-002d-436b-a6c0-d8e4bf067043 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:02.973722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fc6d3e13-002d-436b-a6c0-d8e4bf067043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:03.033458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1246/2486] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:03.042916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:03.044320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:03.102819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df99a0-ac9e-488d-85c4-bf1ca27a0116 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:03.106996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdd3b6-3e88-43db-8f4f-54ac82533ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:03.107657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd3b6-3e88-43db-8f4f-54ac82533ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:03.107948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd3b6-3e88-43db-8f4f-54ac82533ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:03.108227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd3b6-3e88-43db-8f4f-54ac82533ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:03.117773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdd3b6-3e88-43db-8f4f-54ac82533ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:03.119465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdd3b6-3e88-43db-8f4f-54ac82533ad7 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:03.124355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:03.130172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1241/2487] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:03.400380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d3e13-002d-436b-a6c0-d8e4bf067043 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:03.401898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fc6d3e13-002d-436b-a6c0-d8e4bf067043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:03.414338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d3e13-002d-436b-a6c0-d8e4bf067043 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:03.419092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:03.420127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:03.420412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:03.420715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] PATH_INFO: `/v3/projects/9fb39559eb894ebd97df2bd205e1d004` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:03.421987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb39559eb894ebd97df2bd205e1d004)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:03.423974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:03.471736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb39559eb894ebd97df2bd205e1d004', 'request_id': 'req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.478771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb39559eb894ebd97df2bd205e1d004', 'request_id': 'req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.486613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb39559eb894ebd97df2bd205e1d004', 'request_id': 'req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.497484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] The token cache is being invalidate because project 9fb39559eb894ebd97df2bd205e1d004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:03.497809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.498442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.500545 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1247/2488] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:03 2022] DELETE /identity/v3/projects/9fb39559eb894ebd97df2bd205e1d004 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:03.504640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdd3b6-3e88-43db-8f4f-54ac82533ad7 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:03.514270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdd3b6-3e88-43db-8f4f-54ac82533ad7 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:03.570913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:03.571835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:03.572123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:03.572402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] PATH_INFO: `/v3/users/83899dae88034d3689e210a25408a15c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:03.573625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83899dae88034d3689e210a25408a15c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:03.575552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:03.620613 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83899dae88034d3689e210a25408a15c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.621260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83899dae88034d3689e210a25408a15c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.628944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83899dae88034d3689e210a25408a15c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.641140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83899dae88034d3689e210a25408a15c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.648004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9ac8a739-5add-49a0-852e-6775551e9ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83899dae88034d3689e210a25408a15c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:03.653901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1242/2489] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:03 2022] DELETE /identity/v3/users/83899dae88034d3689e210a25408a15c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:03.925976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:03.927467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:03.941945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210e4d7-9c61-49b9-974a-c0a8cd3d571c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:03.961140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:04.002298 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.003170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.003462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.003745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] PATH_INFO: `/v3/projects/d574c9b8e7cd43fc8646782db5662e86` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.004934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d574c9b8e7cd43fc8646782db5662e86)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.006896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.052930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd574c9b8e7cd43fc8646782db5662e86', 'request_id': 'req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.058949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd574c9b8e7cd43fc8646782db5662e86', 'request_id': 'req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.067040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd574c9b8e7cd43fc8646782db5662e86', 'request_id': 'req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.082922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] The token cache is being invalidate because project d574c9b8e7cd43fc8646782db5662e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:04.083308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.084078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c1123b6-1c2d-4ce7-8761-3b495fbbff90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.085734 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1248/2490] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:03 2022] DELETE /identity/v3/projects/d574c9b8e7cd43fc8646782db5662e86 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:04.092208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221e0f-42e1-4d1c-872c-27e657073dc9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.092702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221e0f-42e1-4d1c-872c-27e657073dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.092798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221e0f-42e1-4d1c-872c-27e657073dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.110549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0a221e0f-42e1-4d1c-872c-27e657073dc9 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:04.111655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0a221e0f-42e1-4d1c-872c-27e657073dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:04.170358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1243/2491] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:04.179783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd2c2-91df-4990-a4d8-3a24efe2e070 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.180077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd2c2-91df-4990-a4d8-3a24efe2e070 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.180395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd2c2-91df-4990-a4d8-3a24efe2e070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.200008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4f1bd2c2-91df-4990-a4d8-3a24efe2e070 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:04.201228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4f1bd2c2-91df-4990-a4d8-3a24efe2e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:04.209999 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1249/2492] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:04.214279 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221e0f-42e1-4d1c-872c-27e657073dc9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.224160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221e0f-42e1-4d1c-872c-27e657073dc9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:04.228791 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.229452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.229779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.230067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.230817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:04.231117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.232727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.244655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1244/2493] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:10:04.249083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bd2c2-91df-4990-a4d8-3a24efe2e070 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.258700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bd2c2-91df-4990-a4d8-3a24efe2e070 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:04.263374 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f7637-9fc2-4989-a7ca-569d5f0f2a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.264023 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7637-9fc2-4989-a7ca-569d5f0f2a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.264311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7637-9fc2-4989-a7ca-569d5f0f2a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.264594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7637-9fc2-4989-a7ca-569d5f0f2a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.265284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f7637-9fc2-4989-a7ca-569d5f0f2a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.267796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f7637-9fc2-4989-a7ca-569d5f0f2a03 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.292815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1250/2494] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:04 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:04.297073 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.307074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6b597-e5d4-4925-95ce-3580309f4714 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:04.310741 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:04.366818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26685103-b23e-4203-b29e-4eb1886b6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.367425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685103-b23e-4203-b29e-4eb1886b6156 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.367715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685103-b23e-4203-b29e-4eb1886b6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.368003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685103-b23e-4203-b29e-4eb1886b6156 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.368731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26685103-b23e-4203-b29e-4eb1886b6156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.370997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26685103-b23e-4203-b29e-4eb1886b6156 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.397373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1245/2495] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:04 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:04.398561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f7637-9fc2-4989-a7ca-569d5f0f2a03 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.409259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f7637-9fc2-4989-a7ca-569d5f0f2a03 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:04.414141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15d37-dae1-4db2-8e37-73a5d7310ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.414809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15d37-dae1-4db2-8e37-73a5d7310ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.415101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15d37-dae1-4db2-8e37-73a5d7310ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.415386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15d37-dae1-4db2-8e37-73a5d7310ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.416118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db15d37-dae1-4db2-8e37-73a5d7310ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.417754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db15d37-dae1-4db2-8e37-73a5d7310ffb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.429040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1251/2496] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:04.432970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26685103-b23e-4203-b29e-4eb1886b6156 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.443754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26685103-b23e-4203-b29e-4eb1886b6156 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:04.448509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316d8d-09c8-4947-9002-32a141a9b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.449164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316d8d-09c8-4947-9002-32a141a9b637 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.449458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316d8d-09c8-4947-9002-32a141a9b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.449777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316d8d-09c8-4947-9002-32a141a9b637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.450514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316d8d-09c8-4947-9002-32a141a9b637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.452117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316d8d-09c8-4947-9002-32a141a9b637 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.462708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1246/2497] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:04.466785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15d37-dae1-4db2-8e37-73a5d7310ffb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.477427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15d37-dae1-4db2-8e37-73a5d7310ffb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:04.482090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.482968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.483259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.483546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] PATH_INFO: `/v3/projects/e9187e517af84f9883abd0662264e79e/users/176e9624ed284c6d82b265091bf404cf/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.498070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9187e517af84f9883abd0662264e79e, user_id=176e9624ed284c6d82b265091bf404cf, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.501157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.514711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1252/2498] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:04 2022] PUT /identity/v3/projects/e9187e517af84f9883abd0662264e79e/users/176e9624ed284c6d82b265091bf404cf/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:04.526479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926f81-52b3-4b1e-8865-a446d92538cf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.526777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926f81-52b3-4b1e-8865-a446d92538cf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.527071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926f81-52b3-4b1e-8865-a446d92538cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.554088 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b9926f81-52b3-4b1e-8865-a446d92538cf None None] MFA Rules not processed for user `176e9624ed284c6d82b265091bf404cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:04.555290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9926f81-52b3-4b1e-8865-a446d92538cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:04.619806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1247/2499] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:04.631747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.634062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:04.688113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:04.692284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef54b-e0bd-4395-8eb6-1054739e5d3c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:04.697253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83fc99-2169-4a4c-b065-659fcdb5d1d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.698116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83fc99-2169-4a4c-b065-659fcdb5d1d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.698576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83fc99-2169-4a4c-b065-659fcdb5d1d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.699008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83fc99-2169-4a4c-b065-659fcdb5d1d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.708432 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83fc99-2169-4a4c-b065-659fcdb5d1d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.709886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83fc99-2169-4a4c-b065-659fcdb5d1d7 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.718585 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1253/2500] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:04.738026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9926f81-52b3-4b1e-8865-a446d92538cf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.800252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9926f81-52b3-4b1e-8865-a446d92538cf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:04.804877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:04.805781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.806177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.806464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] PATH_INFO: `/v3/users/176e9624ed284c6d82b265091bf404cf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.807664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] RBAC: Authorizing `identity:delete_user(user_id=176e9624ed284c6d82b265091bf404cf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:04.809651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:04.827137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:04.858285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176e9624ed284c6d82b265091bf404cf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.858947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176e9624ed284c6d82b265091bf404cf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.865920 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176e9624ed284c6d82b265091bf404cf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.880267 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176e9624ed284c6d82b265091bf404cf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.888031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176e9624ed284c6d82b265091bf404cf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:04.895174 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1248/2501] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:04 2022] DELETE /identity/v3/users/176e9624ed284c6d82b265091bf404cf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:04.899706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1f1f-0a59-4f07-ab31-72daceb3a946 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:04.900033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1f1f-0a59-4f07-ab31-72daceb3a946 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:04.900320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1f1f-0a59-4f07-ab31-72daceb3a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:04.917724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1d3a1f1f-0a59-4f07-ab31-72daceb3a946 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:04.918813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d3a1f1f-0a59-4f07-ab31-72daceb3a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:04.976450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1254/2502] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:04.986027 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:04.987521 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:05.043930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98048c-a585-4aa1-8bbb-96030dd3731e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:05.047747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449827d-bf29-4775-b56a-065872510e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:05.048391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449827d-bf29-4775-b56a-065872510e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.048683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449827d-bf29-4775-b56a-065872510e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.048965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449827d-bf29-4775-b56a-065872510e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.057918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449827d-bf29-4775-b56a-065872510e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:05.059361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449827d-bf29-4775-b56a-065872510e08 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:05.069516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1249/2503] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:05.344277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1f1f-0a59-4f07-ab31-72daceb3a946 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:05.345830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d3a1f1f-0a59-4f07-ab31-72daceb3a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:05.358926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1f1f-0a59-4f07-ab31-72daceb3a946 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:05.364346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:05.365216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.365499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.365812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] PATH_INFO: `/v3/projects/e9187e517af84f9883abd0662264e79e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.366994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9187e517af84f9883abd0662264e79e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:05.368901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:05.419713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9187e517af84f9883abd0662264e79e', 'request_id': 'req-811bd9b7-c668-4ca4-8473-c23029314c1d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:05.426629 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9187e517af84f9883abd0662264e79e', 'request_id': 'req-811bd9b7-c668-4ca4-8473-c23029314c1d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:05.434247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9187e517af84f9883abd0662264e79e', 'request_id': 'req-811bd9b7-c668-4ca4-8473-c23029314c1d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:05.445513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] The token cache is being invalidate because project e9187e517af84f9883abd0662264e79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:05.445845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:05.446482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-811bd9b7-c668-4ca4-8473-c23029314c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:05.448040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1255/2504] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:05 2022] DELETE /identity/v3/projects/e9187e517af84f9883abd0662264e79e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:05.453137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5793a4-907f-4b8c-bbb4-c5173f08cd6a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.453690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5793a4-907f-4b8c-bbb4-c5173f08cd6a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.453865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5793a4-907f-4b8c-bbb4-c5173f08cd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.471248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fa5793a4-907f-4b8c-bbb4-c5173f08cd6a None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:05.472461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fa5793a4-907f-4b8c-bbb4-c5173f08cd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:05.532462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1250/2505] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:05.540359 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cdd3d-cc7e-4992-ae0a-673c45f34b89 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.540655 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cdd3d-cc7e-4992-ae0a-673c45f34b89 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.540943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cdd3d-cc7e-4992-ae0a-673c45f34b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.559528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f02cdd3d-cc7e-4992-ae0a-673c45f34b89 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:05.560745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f02cdd3d-cc7e-4992-ae0a-673c45f34b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:05.568742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1256/2506] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:05.572809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5793a4-907f-4b8c-bbb4-c5173f08cd6a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:05.582388 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5793a4-907f-4b8c-bbb4-c5173f08cd6a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:05.587009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:05.587689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.587978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.588259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.588981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:05.589290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:05.590931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:05.605284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1251/2507] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:10:05.610341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cdd3d-cc7e-4992-ae0a-673c45f34b89 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:05.623525 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cdd3d-cc7e-4992-ae0a-673c45f34b89 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:05.629816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47246-e983-4510-ac0f-f2978977e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:05.630538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47246-e983-4510-ac0f-f2978977e1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.630829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47246-e983-4510-ac0f-f2978977e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.631806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47246-e983-4510-ac0f-f2978977e1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.632524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc47246-e983-4510-ac0f-f2978977e1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:05.634476 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc47246-e983-4510-ac0f-f2978977e1c1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:05.660254 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1257/2508] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:05 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:05.664406 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:05.675499 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d4d40-1eef-40c9-b857-5d2d83b3f6f8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:05.696822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:05.736058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafce0e-3626-4d24-958a-bee05d83c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:05.736734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafce0e-3626-4d24-958a-bee05d83c0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.737021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafce0e-3626-4d24-958a-bee05d83c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.737302 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafce0e-3626-4d24-958a-bee05d83c0a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.738066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafce0e-3626-4d24-958a-bee05d83c0a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:05.740000 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafce0e-3626-4d24-958a-bee05d83c0a0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:05.759842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1252/2509] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:05 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:05.763928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47246-e983-4510-ac0f-f2978977e1c1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:05.774334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47246-e983-4510-ac0f-f2978977e1c1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:05.779012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68282f-0aa3-4f11-855a-ff21323226a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:05.779667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68282f-0aa3-4f11-855a-ff21323226a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.779955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68282f-0aa3-4f11-855a-ff21323226a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.780236 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68282f-0aa3-4f11-855a-ff21323226a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.780955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68282f-0aa3-4f11-855a-ff21323226a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:05.783171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68282f-0aa3-4f11-855a-ff21323226a4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:05.794414 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1258/2510] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:05.798875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafce0e-3626-4d24-958a-bee05d83c0a0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:05.808795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafce0e-3626-4d24-958a-bee05d83c0a0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:05.813430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871a9f-6eef-49b9-a54d-0ddbbac48ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:05.814121 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871a9f-6eef-49b9-a54d-0ddbbac48ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.814409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871a9f-6eef-49b9-a54d-0ddbbac48ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.814687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871a9f-6eef-49b9-a54d-0ddbbac48ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.815414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25871a9f-6eef-49b9-a54d-0ddbbac48ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:05.817012 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25871a9f-6eef-49b9-a54d-0ddbbac48ffe admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:05.826887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1253/2511] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:05.830904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68282f-0aa3-4f11-855a-ff21323226a4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:05.840645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68282f-0aa3-4f11-855a-ff21323226a4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:05.845833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:05.846711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.846991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.847268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] PATH_INFO: `/v3/projects/4bf16d74529d40009b717c1ecb2d81c6/users/60fa6b5132aa4ab9984b1e0fe5ae5f6a/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.862118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf16d74529d40009b717c1ecb2d81c6, user_id=60fa6b5132aa4ab9984b1e0fe5ae5f6a, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:05.864794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:05.878124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1259/2512] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:05 2022] PUT /identity/v3/projects/4bf16d74529d40009b717c1ecb2d81c6/users/60fa6b5132aa4ab9984b1e0fe5ae5f6a/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:05.888976 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bbf1b-3d5d-46c9-8416-19cf72bf4d29 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:05.889272 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bbf1b-3d5d-46c9-8416-19cf72bf4d29 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:05.889582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bbf1b-3d5d-46c9-8416-19cf72bf4d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:05.917758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e89bbf1b-3d5d-46c9-8416-19cf72bf4d29 None None] MFA Rules not processed for user `60fa6b5132aa4ab9984b1e0fe5ae5f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:05.918956 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e89bbf1b-3d5d-46c9-8416-19cf72bf4d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:05.983371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1254/2513] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:05.995038 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:05.996746 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:06.010807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:06.055459 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776594-d33e-44bf-be15-bd0fc2751dc7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:06.059127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0131f55-47f6-45ee-8170-d536e157b6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:06.059781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131f55-47f6-45ee-8170-d536e157b6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:06.060070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131f55-47f6-45ee-8170-d536e157b6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:06.060357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131f55-47f6-45ee-8170-d536e157b6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:06.069301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0131f55-47f6-45ee-8170-d536e157b6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:06.070762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0131f55-47f6-45ee-8170-d536e157b6b1 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:06.079605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1260/2514] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:15.480555 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bbf1b-3d5d-46c9-8416-19cf72bf4d29 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:15.543467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bbf1b-3d5d-46c9-8416-19cf72bf4d29 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:15.548197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:15.549071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:15.549363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:15.549679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] PATH_INFO: `/v3/users/60fa6b5132aa4ab9984b1e0fe5ae5f6a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:15.551465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fa6b5132aa4ab9984b1e0fe5ae5f6a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:15.553399 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:15.590605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:15.602288 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fa6b5132aa4ab9984b1e0fe5ae5f6a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:15.602966 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fa6b5132aa4ab9984b1e0fe5ae5f6a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:15.609880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fa6b5132aa4ab9984b1e0fe5ae5f6a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:15.622116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fa6b5132aa4ab9984b1e0fe5ae5f6a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:15.629038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fa6b5132aa4ab9984b1e0fe5ae5f6a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:15.635003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1255/2515] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:15 2022] DELETE /identity/v3/users/60fa6b5132aa4ab9984b1e0fe5ae5f6a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:15.639463 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974b9f5-a882-45e4-8707-47ea5bb31974 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:15.639937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974b9f5-a882-45e4-8707-47ea5bb31974 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:15.640054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974b9f5-a882-45e4-8707-47ea5bb31974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:15.657322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4974b9f5-a882-45e4-8707-47ea5bb31974 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:15.658559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4974b9f5-a882-45e4-8707-47ea5bb31974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:15.717642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1261/2516] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:15.727904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:15.729330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:15.786951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69176129-ef0c-4275-970e-abdade674a98 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:15.790669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af6a4-a684-4ce7-8f77-531d76d796e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:15.791325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af6a4-a684-4ce7-8f77-531d76d796e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:15.791619 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af6a4-a684-4ce7-8f77-531d76d796e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:15.791909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af6a4-a684-4ce7-8f77-531d76d796e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:15.801470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4af6a4-a684-4ce7-8f77-531d76d796e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:15.802970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4af6a4-a684-4ce7-8f77-531d76d796e2 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:15.812496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1256/2517] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:16.077872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974b9f5-a882-45e4-8707-47ea5bb31974 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:16.079422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4974b9f5-a882-45e4-8707-47ea5bb31974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:16.096604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974b9f5-a882-45e4-8707-47ea5bb31974 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:16.103544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:16.104635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.104949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.105127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] PATH_INFO: `/v3/projects/4bf16d74529d40009b717c1ecb2d81c6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.106635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf16d74529d40009b717c1ecb2d81c6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:16.109311 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:16.157034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf16d74529d40009b717c1ecb2d81c6', 'request_id': 'req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:16.163920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf16d74529d40009b717c1ecb2d81c6', 'request_id': 'req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:16.170872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf16d74529d40009b717c1ecb2d81c6', 'request_id': 'req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:16.181869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] The token cache is being invalidate because project 4bf16d74529d40009b717c1ecb2d81c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:16.182159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:16.182808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-97b6352f-2f34-4de7-a3b3-5dbd07011ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:16.184351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1262/2518] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:16 2022] DELETE /identity/v3/projects/4bf16d74529d40009b717c1ecb2d81c6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:16.189216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44ee8-0ba9-41b4-aefa-7123e5062d4f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.189535 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44ee8-0ba9-41b4-aefa-7123e5062d4f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.189886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44ee8-0ba9-41b4-aefa-7123e5062d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.209098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c8c44ee8-0ba9-41b4-aefa-7123e5062d4f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:16.210359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c8c44ee8-0ba9-41b4-aefa-7123e5062d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:16.270130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1257/2519] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:16.277805 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ec1b-063e-4c96-b372-7a5435055e35 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.278103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ec1b-063e-4c96-b372-7a5435055e35 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.278390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ec1b-063e-4c96-b372-7a5435055e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.296766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6188ec1b-063e-4c96-b372-7a5435055e35 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:16.298021 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6188ec1b-063e-4c96-b372-7a5435055e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:16.306582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1263/2520] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:16.310603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c44ee8-0ba9-41b4-aefa-7123e5062d4f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:16.320339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c44ee8-0ba9-41b4-aefa-7123e5062d4f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:16.325263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:16.325982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.326274 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.326588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.327320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:16.327637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:16.329262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:16.342978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1258/2521] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:10:16.347907 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188ec1b-063e-4c96-b372-7a5435055e35 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:16.357851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188ec1b-063e-4c96-b372-7a5435055e35 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:16.362739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba29a8-9e1f-4435-8cdc-65bd87518a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:16.363497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba29a8-9e1f-4435-8cdc-65bd87518a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.363760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba29a8-9e1f-4435-8cdc-65bd87518a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.364044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba29a8-9e1f-4435-8cdc-65bd87518a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.364742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba29a8-9e1f-4435-8cdc-65bd87518a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:16.366676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba29a8-9e1f-4435-8cdc-65bd87518a1d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:16.396440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1264/2522] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:16 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:16.397979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:16.408692 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1939d60-6b1f-49b3-b92c-677d67c93cb4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:16.450294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:16.474479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873aa3-cf93-4637-baf3-7043aa549729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:16.475167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873aa3-cf93-4637-baf3-7043aa549729 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.475460 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873aa3-cf93-4637-baf3-7043aa549729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.475733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873aa3-cf93-4637-baf3-7043aa549729 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.476459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873aa3-cf93-4637-baf3-7043aa549729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:16.478458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873aa3-cf93-4637-baf3-7043aa549729 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:16.505979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1259/2523] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:16 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:16.510148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba29a8-9e1f-4435-8cdc-65bd87518a1d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:16.521063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba29a8-9e1f-4435-8cdc-65bd87518a1d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:16.525674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514d2bc-a0d2-4838-9dbd-66745dbb0413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:16.526336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514d2bc-a0d2-4838-9dbd-66745dbb0413 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.526623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514d2bc-a0d2-4838-9dbd-66745dbb0413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.526906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514d2bc-a0d2-4838-9dbd-66745dbb0413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.527635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514d2bc-a0d2-4838-9dbd-66745dbb0413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:16.529226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514d2bc-a0d2-4838-9dbd-66745dbb0413 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:16.531273 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:16.542199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1265/2524] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:16.545935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873aa3-cf93-4637-baf3-7043aa549729 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:16.556259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873aa3-cf93-4637-baf3-7043aa549729 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:16.560843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca1070-9787-4a69-8acd-8333a1eb68e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:16.561497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1070-9787-4a69-8acd-8333a1eb68e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.561810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1070-9787-4a69-8acd-8333a1eb68e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.562087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1070-9787-4a69-8acd-8333a1eb68e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.562805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca1070-9787-4a69-8acd-8333a1eb68e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:16.564562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca1070-9787-4a69-8acd-8333a1eb68e0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:16.575337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1260/2525] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:16.579304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514d2bc-a0d2-4838-9dbd-66745dbb0413 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:16.589666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514d2bc-a0d2-4838-9dbd-66745dbb0413 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:16.594463 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:16.595346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.595631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.595912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] PATH_INFO: `/v3/projects/69e36e2fc5004ae0bbec1acade512c2a/users/adb01ba57e244fbabb89b97f61b64050/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.610920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e36e2fc5004ae0bbec1acade512c2a, user_id=adb01ba57e244fbabb89b97f61b64050, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:16.613594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:16.626594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1266/2526] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:16 2022] PUT /identity/v3/projects/69e36e2fc5004ae0bbec1acade512c2a/users/adb01ba57e244fbabb89b97f61b64050/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:16.631848 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2666-700c-4ebd-b5e1-7617bfa16db0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.632146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2666-700c-4ebd-b5e1-7617bfa16db0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.632437 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2666-700c-4ebd-b5e1-7617bfa16db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.650140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-423d2666-700c-4ebd-b5e1-7617bfa16db0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:16.651344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-423d2666-700c-4ebd-b5e1-7617bfa16db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:16.713221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1261/2527] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:16.723453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:16.725224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:16.782565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba5be6-e38a-4817-8901-d106195c9677 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:16.786310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:16.786961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:16.787252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:16.787539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:16.797000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:16.798472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:16.808669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1267/2528] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:17.424013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd514-44ab-4b98-8d3f-c0807ccc7b12 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:17.424295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd514-44ab-4b98-8d3f-c0807ccc7b12 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:17.424574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd514-44ab-4b98-8d3f-c0807ccc7b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:17.451796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-763dd514-44ab-4b98-8d3f-c0807ccc7b12 None None] MFA Rules not processed for user `adb01ba57e244fbabb89b97f61b64050`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:17.453072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-763dd514-44ab-4b98-8d3f-c0807ccc7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:17.532190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1262/2529] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:17.548475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:17.548475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:17.601402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0cafa-de02-4734-adc6-9a10b2436413 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:17.605072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:17.605760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:17.606050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:17.606334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:17.615428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:17.616858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:17.625825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1268/2530] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:18.972938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7d2e1-97ee-4904-a8db-1ad29ade4aa2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:18.973438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7d2e1-97ee-4904-a8db-1ad29ade4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:18.973579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7d2e1-97ee-4904-a8db-1ad29ade4aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:18.991537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0bf7d2e1-97ee-4904-a8db-1ad29ade4aa2 None None] MFA Rules not processed for user `adb01ba57e244fbabb89b97f61b64050`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:18.992758 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0bf7d2e1-97ee-4904-a8db-1ad29ade4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:19.000206 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1263/2531] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:19.547569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:19.549007 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:19.623251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdcbea-0d26-4032-948a-fc26adb492ac service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:19.628365 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:19.629037 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:19.629399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:19.629721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:19.631527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:19.643235 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:19.645587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:19.656398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1269/2532] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:21.540815 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7d2e1-97ee-4904-a8db-1ad29ade4aa2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:21.542240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0bf7d2e1-97ee-4904-a8db-1ad29ade4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:21.554984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7d2e1-97ee-4904-a8db-1ad29ade4aa2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:21.558620 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:21.559278 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:21.559588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:21.559872 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:21.561700 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:21.572788 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:21.574271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:21.583034 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1264/2533] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:25.784406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:25.794344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24077-bc8c-4a90-a4f2-44ac664e979f service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:25.797891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:25.798527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:25.798812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:25.799091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:25.800990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:25.804922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:25.884010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:25.885442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:25.903562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1270/2534] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:31.578841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:32.768025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:32.777100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba4cb-f2e5-4163-bf40-48abb96c9c11 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:32.781159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c319e1e-4557-4f2d-bad6-78a8cf75281f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:32.781952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c319e1e-4557-4f2d-bad6-78a8cf75281f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:32.782250 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c319e1e-4557-4f2d-bad6-78a8cf75281f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:32.782541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c319e1e-4557-4f2d-bad6-78a8cf75281f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:32.785694 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c319e1e-4557-4f2d-bad6-78a8cf75281f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:32.798884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c319e1e-4557-4f2d-bad6-78a8cf75281f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:32.800347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c319e1e-4557-4f2d-bad6-78a8cf75281f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:32.813767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1265/2535] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:33.006211 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:33.015531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40e120-284b-4e2e-97df-93856cda6b61 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:33.019201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:33.020197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:33.020495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:33.020782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:33.022712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:33.035300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:33.036741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:33.046877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1271/2536] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:35.970860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c50b65-61c8-43c0-8f67-bed10c5d1f5d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:35.971698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c50b65-61c8-43c0-8f67-bed10c5d1f5d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:35.971992 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c50b65-61c8-43c0-8f67-bed10c5d1f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:35.993005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b9c50b65-61c8-43c0-8f67-bed10c5d1f5d None None] MFA Rules not processed for user `adb01ba57e244fbabb89b97f61b64050`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:35.996122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9c50b65-61c8-43c0-8f67-bed10c5d1f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:36.006828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1266/2537] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:37.867224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:37.870885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:37.903020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3d0c-9f06-4ce7-b35a-2b46b4cadd65 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:37.924416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:37.927163 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:37.927634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:37.928388 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] PATH_INFO: `/v3/users/8986cbf0b3534177a6436113896b161d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:37.930637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8986cbf0b3534177a6436113896b161d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:37.934653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:38.006985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8986cbf0b3534177a6436113896b161d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.007695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8986cbf0b3534177a6436113896b161d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.015274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8986cbf0b3534177a6436113896b161d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.042185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8986cbf0b3534177a6436113896b161d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.042976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8986cbf0b3534177a6436113896b161d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.070272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1272/2538] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:37 2022] DELETE /identity/v3/users/8986cbf0b3534177a6436113896b161d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:38.250320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c50b65-61c8-43c0-8f67-bed10c5d1f5d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:38.252616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9c50b65-61c8-43c0-8f67-bed10c5d1f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:38.284248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c50b65-61c8-43c0-8f67-bed10c5d1f5d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:38.396693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:38.401651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.402440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.402986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] PATH_INFO: `/v3/users/dcd4aeea3a094122a7c7c6944b96cb71` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.423586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:38.426220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:38.439254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd4aeea3a094122a7c7c6944b96cb71)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:38.441285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:38.447486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00ef21-caaf-43bd-9658-19457300b4f7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:38.457451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:38.458775 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.463837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.464426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] PATH_INFO: `/v3/projects/eac6e31ac0884ca596746bb1ccdffdc0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.466448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac6e31ac0884ca596746bb1ccdffdc0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:38.469030 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:38.497986 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd4aeea3a094122a7c7c6944b96cb71'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.498652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd4aeea3a094122a7c7c6944b96cb71'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.509196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd4aeea3a094122a7c7c6944b96cb71'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.513451 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:38.527601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd4aeea3a094122a7c7c6944b96cb71'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.530277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac6e31ac0884ca596746bb1ccdffdc0', 'request_id': 'req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.537223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac6e31ac0884ca596746bb1ccdffdc0', 'request_id': 'req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.538650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-890cbfbf-b031-40e1-92aa-d518d32fa32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd4aeea3a094122a7c7c6944b96cb71'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.547071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac6e31ac0884ca596746bb1ccdffdc0', 'request_id': 'req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.547522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1267/2539] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:38 2022] DELETE /identity/v3/users/dcd4aeea3a094122a7c7c6944b96cb71 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:38.576947 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] The token cache is being invalidate because project eac6e31ac0884ca596746bb1ccdffdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:38.577348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.585702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5812dcc-c92b-49fd-a613-974e5f7d0a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.587403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1273/2540] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:38 2022] DELETE /identity/v3/projects/eac6e31ac0884ca596746bb1ccdffdc0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:38.592260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4518-fa74-49cc-ac81-9041ad3f2c23 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.593332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4518-fa74-49cc-ac81-9041ad3f2c23 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.593332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4518-fa74-49cc-ac81-9041ad3f2c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.616973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-601f4518-fa74-49cc-ac81-9041ad3f2c23 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:38.618239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-601f4518-fa74-49cc-ac81-9041ad3f2c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:38.672081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:38.705500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1268/2541] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:38.714632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2439e-2c68-4a6c-8590-c1a307adddb9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.714924 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2439e-2c68-4a6c-8590-c1a307adddb9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.715207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2439e-2c68-4a6c-8590-c1a307adddb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.740053 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f4518-fa74-49cc-ac81-9041ad3f2c23 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:38.740883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-00b2439e-2c68-4a6c-8590-c1a307adddb9 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:38.742032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-601f4518-fa74-49cc-ac81-9041ad3f2c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:38.742386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-00b2439e-2c68-4a6c-8590-c1a307adddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:38.751956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1274/2542] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:38.756281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2439e-2c68-4a6c-8590-c1a307adddb9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:38.761108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f4518-fa74-49cc-ac81-9041ad3f2c23 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:38.766328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:38.766737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2439e-2c68-4a6c-8590-c1a307adddb9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:38.767803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.768614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.768995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] PATH_INFO: `/v3/projects/f22687437aee4dacb1be127cbcf4209f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.771959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:38.772633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.772921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.773286 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.774009 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:38.774462 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:38.776243 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:38.787935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22687437aee4dacb1be127cbcf4209f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:38.790055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1275/2543] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:10:38.790264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:38.794737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:38.806935 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b2c20-3ae2-4570-943e-fe7a10fa033b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:38.813062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407037-5ca6-4686-a1cd-f897976453bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:38.813770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407037-5ca6-4686-a1cd-f897976453bb admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.814062 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407037-5ca6-4686-a1cd-f897976453bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.814352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407037-5ca6-4686-a1cd-f897976453bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.815158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd407037-5ca6-4686-a1cd-f897976453bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:38.817295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd407037-5ca6-4686-a1cd-f897976453bb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:38.848192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22687437aee4dacb1be127cbcf4209f', 'request_id': 'req-a534c53a-ce84-45d6-8339-0a270c2f7f6a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.848444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1276/2544] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:38 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:38.853367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407037-5ca6-4686-a1cd-f897976453bb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:38.860200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22687437aee4dacb1be127cbcf4209f', 'request_id': 'req-a534c53a-ce84-45d6-8339-0a270c2f7f6a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.870179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22687437aee4dacb1be127cbcf4209f', 'request_id': 'req-a534c53a-ce84-45d6-8339-0a270c2f7f6a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.884757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] The token cache is being invalidate because project f22687437aee4dacb1be127cbcf4209f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:38.885079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.885790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a534c53a-ce84-45d6-8339-0a270c2f7f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:38.887533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1269/2545] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:38 2022] DELETE /identity/v3/projects/f22687437aee4dacb1be127cbcf4209f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:38.892725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e990c87-30d6-4fc2-bde2-4a4099761425 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.893565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e990c87-30d6-4fc2-bde2-4a4099761425 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.894603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e990c87-30d6-4fc2-bde2-4a4099761425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.915356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7e990c87-30d6-4fc2-bde2-4a4099761425 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:38.917324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7e990c87-30d6-4fc2-bde2-4a4099761425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:38.920141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407037-5ca6-4686-a1cd-f897976453bb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:38.925753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:38.926281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.926752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.926875 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.927537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:38.930077 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1270/2546] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:38.930325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:38.940003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8499b1-4da7-482f-ad87-9f0e5c03c042 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.940297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8499b1-4da7-482f-ad87-9f0e5c03c042 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.940608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8499b1-4da7-482f-ad87-9f0e5c03c042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.959281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1277/2547] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:38 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:38.963158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:38.965160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:38.970982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2d8499b1-4da7-482f-ad87-9f0e5c03c042 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:38.972176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2d8499b1-4da7-482f-ad87-9f0e5c03c042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:38.980961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1271/2548] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:38.982080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd46c5-b166-46d3-8d2e-d432a12dc1fc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:38.985998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8499b1-4da7-482f-ad87-9f0e5c03c042 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:38.988818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c5cb-ac12-41e3-89c3-4d682de2f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:38.989673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c5cb-ac12-41e3-89c3-4d682de2f248 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:38.990083 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c5cb-ac12-41e3-89c3-4d682de2f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:38.990437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c5cb-ac12-41e3-89c3-4d682de2f248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:38.991255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c5cb-ac12-41e3-89c3-4d682de2f248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:38.993244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c5cb-ac12-41e3-89c3-4d682de2f248 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:38.998090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8499b1-4da7-482f-ad87-9f0e5c03c042 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.004736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.005418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.005739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.006023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.006755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:39.007067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.009573 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.011427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1278/2549] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:39.012716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c5cb-ac12-41e3-89c3-4d682de2f248 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.027193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c5cb-ac12-41e3-89c3-4d682de2f248 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.030904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1272/2550] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:10:39.035348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.036981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34ac5a-e5a9-4b14-9c23-3880fa81f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.038138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34ac5a-e5a9-4b14-9c23-3880fa81f8ee admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.038619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34ac5a-e5a9-4b14-9c23-3880fa81f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.039071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34ac5a-e5a9-4b14-9c23-3880fa81f8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.039975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34ac5a-e5a9-4b14-9c23-3880fa81f8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.041811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34ac5a-e5a9-4b14-9c23-3880fa81f8ee admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.053538 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0d5d-5ea9-4b1c-a69a-88c55d6f1917 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.060422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2765-b078-4a62-889d-1daa5d6fc9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.061105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2765-b078-4a62-889d-1daa5d6fc9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.062337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2765-b078-4a62-889d-1daa5d6fc9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.062640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2765-b078-4a62-889d-1daa5d6fc9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.063416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2765-b078-4a62-889d-1daa5d6fc9f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.066759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2765-b078-4a62-889d-1daa5d6fc9f0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.070733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1279/2551] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:39.072016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34ac5a-e5a9-4b14-9c23-3880fa81f8ee admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.085058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34ac5a-e5a9-4b14-9c23-3880fa81f8ee admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.091548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa28c00-36fe-4ebb-babd-1a8cb4b5263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.093201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa28c00-36fe-4ebb-babd-1a8cb4b5263c admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.093831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa28c00-36fe-4ebb-babd-1a8cb4b5263c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.095043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa28c00-36fe-4ebb-babd-1a8cb4b5263c admin admin] PATH_INFO: `/v3/projects/a297aa663c234f5082ad61303dce0f92/users/1af1472b80594f9fbc1267e763890965/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.105601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1273/2552] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:39 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:39.109646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2765-b078-4a62-889d-1daa5d6fc9f0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.113910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa28c00-36fe-4ebb-babd-1a8cb4b5263c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a297aa663c234f5082ad61303dce0f92, user_id=1af1472b80594f9fbc1267e763890965, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.117888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa28c00-36fe-4ebb-babd-1a8cb4b5263c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.135057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1280/2553] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:39 2022] PUT /identity/v3/projects/a297aa663c234f5082ad61303dce0f92/users/1af1472b80594f9fbc1267e763890965/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:39.146240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc0ad-afa3-4a8b-95fa-fa5424023eb1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.146560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc0ad-afa3-4a8b-95fa-fa5424023eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.146827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc0ad-afa3-4a8b-95fa-fa5424023eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.176248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-08fcc0ad-afa3-4a8b-95fa-fa5424023eb1 None None] MFA Rules not processed for user `1af1472b80594f9fbc1267e763890965`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:39.177689 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-08fcc0ad-afa3-4a8b-95fa-fa5424023eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:39.185925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2765-b078-4a62-889d-1daa5d6fc9f0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.188893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:39.210002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:39.256422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1281/2554] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:39.260915 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc0ad-afa3-4a8b-95fa-fa5424023eb1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.263354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a5de2-18ca-48f3-a7a6-7a765f35313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.264055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5de2-18ca-48f3-a7a6-7a765f35313e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.264359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5de2-18ca-48f3-a7a6-7a765f35313e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.264641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5de2-18ca-48f3-a7a6-7a765f35313e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.265345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a5de2-18ca-48f3-a7a6-7a765f35313e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.267324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a5de2-18ca-48f3-a7a6-7a765f35313e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.275623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc0ad-afa3-4a8b-95fa-fa5424023eb1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.282595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a6e71-c2fe-411d-bcfd-1596f636705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.283356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6e71-c2fe-411d-bcfd-1596f636705a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.283644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6e71-c2fe-411d-bcfd-1596f636705a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.283962 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6e71-c2fe-411d-bcfd-1596f636705a admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.285403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a6e71-c2fe-411d-bcfd-1596f636705a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.287645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a6e71-c2fe-411d-bcfd-1596f636705a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.294338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1274/2555] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:39 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:39.295449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a5de2-18ca-48f3-a7a6-7a765f35313e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.307516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a5de2-18ca-48f3-a7a6-7a765f35313e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.314258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ea48-9b7c-48c8-8520-2be5224cb05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.314945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ea48-9b7c-48c8-8520-2be5224cb05f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.315239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ea48-9b7c-48c8-8520-2be5224cb05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.315532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ea48-9b7c-48c8-8520-2be5224cb05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.317010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ea48-9b7c-48c8-8520-2be5224cb05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.318665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ea48-9b7c-48c8-8520-2be5224cb05f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.319619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1282/2556] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:39 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:39.323790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a6e71-c2fe-411d-bcfd-1596f636705a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.333297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1275/2557] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:39.335071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ea48-9b7c-48c8-8520-2be5224cb05f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.346691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ea48-9b7c-48c8-8520-2be5224cb05f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.398760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a6e71-c2fe-411d-bcfd-1596f636705a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.405061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2047b15-fbb8-41f0-afa6-a4031d2b10e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.406255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047b15-fbb8-41f0-afa6-a4031d2b10e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.406815 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047b15-fbb8-41f0-afa6-a4031d2b10e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.407583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047b15-fbb8-41f0-afa6-a4031d2b10e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.408019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2047b15-fbb8-41f0-afa6-a4031d2b10e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.410783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2047b15-fbb8-41f0-afa6-a4031d2b10e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.415385 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f5194-b171-4a0f-b1be-b73ac68f1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.416217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5194-b171-4a0f-b1be-b73ac68f1fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.416710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5194-b171-4a0f-b1be-b73ac68f1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.417005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5194-b171-4a0f-b1be-b73ac68f1fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.417796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f5194-b171-4a0f-b1be-b73ac68f1fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.422165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f5194-b171-4a0f-b1be-b73ac68f1fb8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.436650 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1276/2558] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:39.437139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1283/2559] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:39 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:39.441166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f5194-b171-4a0f-b1be-b73ac68f1fb8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.442484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2047b15-fbb8-41f0-afa6-a4031d2b10e3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.452488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f5194-b171-4a0f-b1be-b73ac68f1fb8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.457370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2047b15-fbb8-41f0-afa6-a4031d2b10e3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.457898 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3cf2f-e98e-4d42-8796-ddb8b0ce31d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.458787 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3cf2f-e98e-4d42-8796-ddb8b0ce31d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.459177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3cf2f-e98e-4d42-8796-ddb8b0ce31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.459467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3cf2f-e98e-4d42-8796-ddb8b0ce31d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.460533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3cf2f-e98e-4d42-8796-ddb8b0ce31d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.462097 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3cf2f-e98e-4d42-8796-ddb8b0ce31d8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.462652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674bb8-4cba-4e71-bcc1-4482359d9983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.463485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674bb8-4cba-4e71-bcc1-4482359d9983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.463776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674bb8-4cba-4e71-bcc1-4482359d9983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.464064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674bb8-4cba-4e71-bcc1-4482359d9983 admin admin] PATH_INFO: `/v3/projects/f43d99d22ef54bbf8eaf5f0f9249773c/users/345155dc9a1349a4b84d3d7ec3fc68d5/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.477612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1277/2560] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:39.481503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3cf2f-e98e-4d42-8796-ddb8b0ce31d8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.486944 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674bb8-4cba-4e71-bcc1-4482359d9983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43d99d22ef54bbf8eaf5f0f9249773c, user_id=345155dc9a1349a4b84d3d7ec3fc68d5, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.490313 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674bb8-4cba-4e71-bcc1-4482359d9983 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.493565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3cf2f-e98e-4d42-8796-ddb8b0ce31d8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.501118 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39039722-27e1-4521-8450-9d8b41b8c1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.502095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039722-27e1-4521-8450-9d8b41b8c1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.502412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039722-27e1-4521-8450-9d8b41b8c1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.502673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039722-27e1-4521-8450-9d8b41b8c1e0 admin admin] PATH_INFO: `/v3/projects/9100769a40af4ea18bc9c762725ecbc2/users/dc98eb32de354ac0bab7baf33b5605a6/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.507456 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1284/2561] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:39 2022] PUT /identity/v3/projects/f43d99d22ef54bbf8eaf5f0f9249773c/users/345155dc9a1349a4b84d3d7ec3fc68d5/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:39.518733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e38c-7dd6-4a49-ad51-d8366b96806d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.519230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e38c-7dd6-4a49-ad51-d8366b96806d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.520042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e38c-7dd6-4a49-ad51-d8366b96806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.521387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39039722-27e1-4521-8450-9d8b41b8c1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9100769a40af4ea18bc9c762725ecbc2, user_id=dc98eb32de354ac0bab7baf33b5605a6, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.524257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39039722-27e1-4521-8450-9d8b41b8c1e0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.542651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1278/2562] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:39 2022] PUT /identity/v3/projects/9100769a40af4ea18bc9c762725ecbc2/users/dc98eb32de354ac0bab7baf33b5605a6/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:39.546295 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39039722-27e1-4521-8450-9d8b41b8c1e0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.557226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bbd4e38c-7dd6-4a49-ad51-d8366b96806d None None] MFA Rules not processed for user `345155dc9a1349a4b84d3d7ec3fc68d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:39.558596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bbd4e38c-7dd6-4a49-ad51-d8366b96806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:39.606708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:39.629850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39039722-27e1-4521-8450-9d8b41b8c1e0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.633091 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1285/2563] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:39.635243 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37c1b-c285-43c4-8360-91432c10d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.636322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37c1b-c285-43c4-8360-91432c10d560 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.636628 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37c1b-c285-43c4-8360-91432c10d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.636905 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37c1b-c285-43c4-8360-91432c10d560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.645422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37c1b-c285-43c4-8360-91432c10d560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.646158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4e38c-7dd6-4a49-ad51-d8366b96806d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.647563 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bbd4e38c-7dd6-4a49-ad51-d8366b96806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:39.647774 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37c1b-c285-43c4-8360-91432c10d560 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.650916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:39.665884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1279/2564] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:39.667581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37c1b-c285-43c4-8360-91432c10d560 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.678970 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37c1b-c285-43c4-8360-91432c10d560 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.684963 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6cb1-e3c6-46b5-83a1-44d3f3b26f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.686136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6cb1-e3c6-46b5-83a1-44d3f3b26f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.686439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6cb1-e3c6-46b5-83a1-44d3f3b26f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.686729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6cb1-e3c6-46b5-83a1-44d3f3b26f1f admin admin] PATH_INFO: `/v3/projects/9100769a40af4ea18bc9c762725ecbc2/users/dc98eb32de354ac0bab7baf33b5605a6/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.689294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6cb1-e3c6-46b5-83a1-44d3f3b26f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9100769a40af4ea18bc9c762725ecbc2, user_id=dc98eb32de354ac0bab7baf33b5605a6, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.692193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6cb1-e3c6-46b5-83a1-44d3f3b26f1f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.705851 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1280/2565] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:39 2022] PUT /identity/v3/projects/9100769a40af4ea18bc9c762725ecbc2/users/dc98eb32de354ac0bab7baf33b5605a6/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:39.717668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842622-248f-4b8a-b5a2-fc7b6801850a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.718293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842622-248f-4b8a-b5a2-fc7b6801850a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.720223 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842622-248f-4b8a-b5a2-fc7b6801850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.751649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4e38c-7dd6-4a49-ad51-d8366b96806d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.754775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-49842622-248f-4b8a-b5a2-fc7b6801850a None None] MFA Rules not processed for user `dc98eb32de354ac0bab7baf33b5605a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:39.756116 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-49842622-248f-4b8a-b5a2-fc7b6801850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:39.831336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53e5c-c64e-4287-bd16-d62b77ca1671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.832568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53e5c-c64e-4287-bd16-d62b77ca1671 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.832880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53e5c-c64e-4287-bd16-d62b77ca1671 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.833159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53e5c-c64e-4287-bd16-d62b77ca1671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.837997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1281/2566] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:39.850203 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49842622-248f-4b8a-b5a2-fc7b6801850a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:39.851806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-49842622-248f-4b8a-b5a2-fc7b6801850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:39.909673 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af53e5c-c64e-4287-bd16-d62b77ca1671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.911945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af53e5c-c64e-4287-bd16-d62b77ca1671 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.922844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1286/2567] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:39.930635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49842622-248f-4b8a-b5a2-fc7b6801850a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:39.943829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f6cbe-fc96-4598-92fc-829081a312a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:39.944843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f6cbe-fc96-4598-92fc-829081a312a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:39.946152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f6cbe-fc96-4598-92fc-829081a312a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:39.946591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f6cbe-fc96-4598-92fc-829081a312a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:39.964880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f6cbe-fc96-4598-92fc-829081a312a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:39.966379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f6cbe-fc96-4598-92fc-829081a312a0 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:39.977356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1282/2568] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:40.431942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53e5c-c64e-4287-bd16-d62b77ca1671 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:40.453006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:40.495366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53e5c-c64e-4287-bd16-d62b77ca1671 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:40.499975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:40.500852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:40.501141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:40.501425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] PATH_INFO: `/v3/users/1af1472b80594f9fbc1267e763890965` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:40.502653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af1472b80594f9fbc1267e763890965)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:40.504870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:40.556863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af1472b80594f9fbc1267e763890965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:40.557567 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af1472b80594f9fbc1267e763890965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:40.564448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af1472b80594f9fbc1267e763890965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:40.571994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af1472b80594f9fbc1267e763890965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:40.572626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af1472b80594f9fbc1267e763890965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:40.590487 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1287/2569] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:40 2022] DELETE /identity/v3/users/1af1472b80594f9fbc1267e763890965 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:40.595006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689fb1-0e1d-47bb-ab0d-de57a8335c15 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:40.595503 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689fb1-0e1d-47bb-ab0d-de57a8335c15 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:40.595623 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689fb1-0e1d-47bb-ab0d-de57a8335c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:40.614765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4c689fb1-0e1d-47bb-ab0d-de57a8335c15 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:40.615979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4c689fb1-0e1d-47bb-ab0d-de57a8335c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:40.677115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1283/2570] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:40.687127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:40.688578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:40.752383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c34a8-a320-4b1a-82ac-d07abc647111 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:40.756658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac498bb-d46c-41d6-b408-05e9de529e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:40.757314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac498bb-d46c-41d6-b408-05e9de529e9c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:40.757635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac498bb-d46c-41d6-b408-05e9de529e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:40.757918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac498bb-d46c-41d6-b408-05e9de529e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:40.767347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac498bb-d46c-41d6-b408-05e9de529e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:40.768789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac498bb-d46c-41d6-b408-05e9de529e9c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:40.779411 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1288/2571] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:41.059285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689fb1-0e1d-47bb-ab0d-de57a8335c15 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:41.060745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4c689fb1-0e1d-47bb-ab0d-de57a8335c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:41.078163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689fb1-0e1d-47bb-ab0d-de57a8335c15 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:41.083693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:41.084578 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:41.084895 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:41.085180 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] PATH_INFO: `/v3/projects/a297aa663c234f5082ad61303dce0f92` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:41.086464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a297aa663c234f5082ad61303dce0f92)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:41.088391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:41.096796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:41.136496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a297aa663c234f5082ad61303dce0f92', 'request_id': 'req-9243cf63-bfb3-4bce-9ca4-d789327a96d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.146698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a297aa663c234f5082ad61303dce0f92', 'request_id': 'req-9243cf63-bfb3-4bce-9ca4-d789327a96d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.154340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a297aa663c234f5082ad61303dce0f92', 'request_id': 'req-9243cf63-bfb3-4bce-9ca4-d789327a96d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.168347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] The token cache is being invalidate because project a297aa663c234f5082ad61303dce0f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:41.168674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.169408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.173682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1284/2572] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:41 2022] DELETE /identity/v3/projects/a297aa663c234f5082ad61303dce0f92 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:41.175152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac498bb-d46c-41d6-b408-05e9de529e9c service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:41.185747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac498bb-d46c-41d6-b408-05e9de529e9c service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:41.229535 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:41.249854 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:41.250766 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:41.251059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:41.251344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] PATH_INFO: `/v3/users/dc98eb32de354ac0bab7baf33b5605a6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:41.252536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc98eb32de354ac0bab7baf33b5605a6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:41.254831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:41.303249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc98eb32de354ac0bab7baf33b5605a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.303911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc98eb32de354ac0bab7baf33b5605a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.310925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc98eb32de354ac0bab7baf33b5605a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.318744 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc98eb32de354ac0bab7baf33b5605a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.319648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d0b619ce-d009-4a7b-ad5e-4a175020c1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc98eb32de354ac0bab7baf33b5605a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.344753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1289/2573] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:41 2022] DELETE /identity/v3/users/dc98eb32de354ac0bab7baf33b5605a6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:41.629762 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:41.631710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:41.649936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243cf63-bfb3-4bce-9ca4-d789327a96d2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:41.725502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:41.726415 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:41.726710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:41.726999 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] PATH_INFO: `/v3/projects/9100769a40af4ea18bc9c762725ecbc2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:41.728232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9100769a40af4ea18bc9c762725ecbc2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:41.730325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:41.782721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9100769a40af4ea18bc9c762725ecbc2', 'request_id': 'req-b24494e0-050d-431f-a92c-5b130452298c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.790397 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9100769a40af4ea18bc9c762725ecbc2', 'request_id': 'req-b24494e0-050d-431f-a92c-5b130452298c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.796025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9100769a40af4ea18bc9c762725ecbc2', 'request_id': 'req-b24494e0-050d-431f-a92c-5b130452298c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.811157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] The token cache is being invalidate because project 9100769a40af4ea18bc9c762725ecbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:41.811453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.812115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b24494e0-050d-431f-a92c-5b130452298c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:41.813688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1285/2574] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:41 2022] DELETE /identity/v3/projects/9100769a40af4ea18bc9c762725ecbc2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:41.819558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6346b-3779-4ecb-a3d6-49b2613ac9a2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:41.819931 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6346b-3779-4ecb-a3d6-49b2613ac9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:41.820285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6346b-3779-4ecb-a3d6-49b2613ac9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:41.839386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0ce6346b-3779-4ecb-a3d6-49b2613ac9a2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:41.840820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0ce6346b-3779-4ecb-a3d6-49b2613ac9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:41.904136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1290/2575] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:41.913209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffc827-9552-4312-9e86-11ce35a08133 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:41.913507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffc827-9552-4312-9e86-11ce35a08133 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:41.913830 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffc827-9552-4312-9e86-11ce35a08133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:41.933582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-eeffc827-9552-4312-9e86-11ce35a08133 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:41.934786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eeffc827-9552-4312-9e86-11ce35a08133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:41.943366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1286/2576] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:41.947547 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6346b-3779-4ecb-a3d6-49b2613ac9a2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:41.957637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6346b-3779-4ecb-a3d6-49b2613ac9a2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:41.962427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:41.963104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:41.963393 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:41.963679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:41.964418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:41.964732 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:41.966404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:41.979114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1291/2577] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:10:41.983457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffc827-9552-4312-9e86-11ce35a08133 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:41.993457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffc827-9552-4312-9e86-11ce35a08133 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.000254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2671-47f7-40b1-bdaa-b2d5d1f1d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.001043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2671-47f7-40b1-bdaa-b2d5d1f1d098 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.001337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2671-47f7-40b1-bdaa-b2d5d1f1d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.001652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2671-47f7-40b1-bdaa-b2d5d1f1d098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.002370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2671-47f7-40b1-bdaa-b2d5d1f1d098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.004782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2671-47f7-40b1-bdaa-b2d5d1f1d098 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.026091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:42.034227 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1287/2578] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:41 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:42.039973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.051959 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e868713-7b56-46ac-85af-e1452cd3aebd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.098247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:42.111237 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f67c20-c898-4881-a113-fe6622e391bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.111901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67c20-c898-4881-a113-fe6622e391bb admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.112187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67c20-c898-4881-a113-fe6622e391bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.112465 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67c20-c898-4881-a113-fe6622e391bb admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.113937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f67c20-c898-4881-a113-fe6622e391bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.115745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f67c20-c898-4881-a113-fe6622e391bb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.135850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1292/2579] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:42 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:42.140031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2671-47f7-40b1-bdaa-b2d5d1f1d098 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.150512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2671-47f7-40b1-bdaa-b2d5d1f1d098 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.155136 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9be66e-c6f2-424c-bd51-ccd58f521f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.155798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9be66e-c6f2-424c-bd51-ccd58f521f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.156087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9be66e-c6f2-424c-bd51-ccd58f521f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.156372 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9be66e-c6f2-424c-bd51-ccd58f521f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.157104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9be66e-c6f2-424c-bd51-ccd58f521f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.158778 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9be66e-c6f2-424c-bd51-ccd58f521f58 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.169729 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1288/2580] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:42.173430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f67c20-c898-4881-a113-fe6622e391bb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.184051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f67c20-c898-4881-a113-fe6622e391bb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.188769 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e578f-07c3-45c4-8264-5db48c5d8f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.189429 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e578f-07c3-45c4-8264-5db48c5d8f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.189754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e578f-07c3-45c4-8264-5db48c5d8f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.190043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e578f-07c3-45c4-8264-5db48c5d8f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.190777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e578f-07c3-45c4-8264-5db48c5d8f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.192604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e578f-07c3-45c4-8264-5db48c5d8f4b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.204248 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1293/2581] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:42.208247 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9be66e-c6f2-424c-bd51-ccd58f521f58 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.218617 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9be66e-c6f2-424c-bd51-ccd58f521f58 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.223837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacec78f-bb3b-4114-8387-170b8816d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.224716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec78f-bb3b-4114-8387-170b8816d88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.225004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec78f-bb3b-4114-8387-170b8816d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.225287 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec78f-bb3b-4114-8387-170b8816d88d admin admin] PATH_INFO: `/v3/projects/2bc6125cc77749518bc7aaad780eae43/users/3a5e70d1907741b89b14b6ed1ee59ef7/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.240873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacec78f-bb3b-4114-8387-170b8816d88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc6125cc77749518bc7aaad780eae43, user_id=3a5e70d1907741b89b14b6ed1ee59ef7, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.243576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacec78f-bb3b-4114-8387-170b8816d88d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.256953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1289/2582] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:42 2022] PUT /identity/v3/projects/2bc6125cc77749518bc7aaad780eae43/users/3a5e70d1907741b89b14b6ed1ee59ef7/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:42.268382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a548-c5b4-4898-8634-7be13704c40d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.268682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a548-c5b4-4898-8634-7be13704c40d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.269125 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a548-c5b4-4898-8634-7be13704c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.295477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6ca6a548-c5b4-4898-8634-7be13704c40d None None] MFA Rules not processed for user `3a5e70d1907741b89b14b6ed1ee59ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:42.296720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6ca6a548-c5b4-4898-8634-7be13704c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:42.361897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1294/2583] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:42.367153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacec78f-bb3b-4114-8387-170b8816d88d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.429435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacec78f-bb3b-4114-8387-170b8816d88d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.434076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8e76-21d1-41b3-80d9-6641c44533e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.434764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8e76-21d1-41b3-80d9-6641c44533e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.435063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8e76-21d1-41b3-80d9-6641c44533e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.435373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8e76-21d1-41b3-80d9-6641c44533e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.436061 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f8e76-21d1-41b3-80d9-6641c44533e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.438003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f8e76-21d1-41b3-80d9-6641c44533e2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.463577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1290/2584] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:42 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:42.467496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6a548-c5b4-4898-8634-7be13704c40d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.478201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6a548-c5b4-4898-8634-7be13704c40d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.535443 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f1d4-eb10-4563-aa7f-b831b93b0df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.536253 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f1d4-eb10-4563-aa7f-b831b93b0df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.536627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f1d4-eb10-4563-aa7f-b831b93b0df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.536997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f1d4-eb10-4563-aa7f-b831b93b0df9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.537782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f1d4-eb10-4563-aa7f-b831b93b0df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.539738 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f1d4-eb10-4563-aa7f-b831b93b0df9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.560099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1295/2585] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:42 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:42.564067 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8e76-21d1-41b3-80d9-6641c44533e2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.574997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8e76-21d1-41b3-80d9-6641c44533e2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.579687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb5ef-8df0-43d8-9c20-654f39fabc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.580416 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb5ef-8df0-43d8-9c20-654f39fabc39 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.580709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb5ef-8df0-43d8-9c20-654f39fabc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.580995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb5ef-8df0-43d8-9c20-654f39fabc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.581785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cb5ef-8df0-43d8-9c20-654f39fabc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.583546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cb5ef-8df0-43d8-9c20-654f39fabc39 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.594382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1291/2586] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:42.598387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f1d4-eb10-4563-aa7f-b831b93b0df9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.608177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f1d4-eb10-4563-aa7f-b831b93b0df9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.613327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0446059-14cd-43ff-bd1f-86697fab5abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.614376 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0446059-14cd-43ff-bd1f-86697fab5abe admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.614676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0446059-14cd-43ff-bd1f-86697fab5abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.614996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0446059-14cd-43ff-bd1f-86697fab5abe admin admin] PATH_INFO: `/v3/projects/dfad2bf9d1a943a7882d365a649a6cfe/users/578bea7400614957a192680f7a7ec294/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.630636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0446059-14cd-43ff-bd1f-86697fab5abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfad2bf9d1a943a7882d365a649a6cfe, user_id=578bea7400614957a192680f7a7ec294, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.633295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0446059-14cd-43ff-bd1f-86697fab5abe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.647921 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1296/2587] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:42 2022] PUT /identity/v3/projects/dfad2bf9d1a943a7882d365a649a6cfe/users/578bea7400614957a192680f7a7ec294/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:42.652054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb5ef-8df0-43d8-9c20-654f39fabc39 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.663028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb5ef-8df0-43d8-9c20-654f39fabc39 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.724050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17791ba7-5e6a-4a0e-a448-e151e1c7a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.725082 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791ba7-5e6a-4a0e-a448-e151e1c7a627 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.725646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791ba7-5e6a-4a0e-a448-e151e1c7a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.726011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791ba7-5e6a-4a0e-a448-e151e1c7a627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.727092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791ba7-5e6a-4a0e-a448-e151e1c7a627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.729766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791ba7-5e6a-4a0e-a448-e151e1c7a627 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.741799 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1292/2588] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:42.746178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0446059-14cd-43ff-bd1f-86697fab5abe admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.756716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0446059-14cd-43ff-bd1f-86697fab5abe admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.761516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.762426 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.762716 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.763000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] PATH_INFO: `/v3/projects/dfad2bf9d1a943a7882d365a649a6cfe/users/578bea7400614957a192680f7a7ec294/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.765087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfad2bf9d1a943a7882d365a649a6cfe, user_id=578bea7400614957a192680f7a7ec294, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.767758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.778826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1297/2589] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:42 2022] PUT /identity/v3/projects/dfad2bf9d1a943a7882d365a649a6cfe/users/578bea7400614957a192680f7a7ec294/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:42.789278 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd160db-09d8-4a7d-a6cb-aae2d9ed1d86 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.789615 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd160db-09d8-4a7d-a6cb-aae2d9ed1d86 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.789948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd160db-09d8-4a7d-a6cb-aae2d9ed1d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.816403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fdd160db-09d8-4a7d-a6cb-aae2d9ed1d86 None None] MFA Rules not processed for user `578bea7400614957a192680f7a7ec294`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:42.817745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fdd160db-09d8-4a7d-a6cb-aae2d9ed1d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:42.840075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:42.892655 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1293/2590] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:42.904511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:42.906239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:42.918100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:42.967139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd22db-3acd-4f3c-98d5-4ecc0ac1cc55 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:42.970785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c5ff-a20a-450f-bd70-2e8156166394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:42.971424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c5ff-a20a-450f-bd70-2e8156166394 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:42.971708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c5ff-a20a-450f-bd70-2e8156166394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:42.972015 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c5ff-a20a-450f-bd70-2e8156166394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:42.981135 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c5ff-a20a-450f-bd70-2e8156166394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:42.982575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c5ff-a20a-450f-bd70-2e8156166394 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:42.992058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1298/2591] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:43.058806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd160db-09d8-4a7d-a6cb-aae2d9ed1d86 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:43.127037 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd160db-09d8-4a7d-a6cb-aae2d9ed1d86 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:43.132585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:43.133665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:43.134107 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:43.134393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] PATH_INFO: `/v3/users/3a5e70d1907741b89b14b6ed1ee59ef7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:43.135646 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5e70d1907741b89b14b6ed1ee59ef7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:43.137627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:43.186379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5e70d1907741b89b14b6ed1ee59ef7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.187044 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5e70d1907741b89b14b6ed1ee59ef7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.194745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5e70d1907741b89b14b6ed1ee59ef7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.208445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5e70d1907741b89b14b6ed1ee59ef7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.215280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5e70d1907741b89b14b6ed1ee59ef7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.221318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1294/2592] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:43 2022] DELETE /identity/v3/users/3a5e70d1907741b89b14b6ed1ee59ef7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:43.226152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4312e-9ee3-4fd8-9573-8aba4fe98239 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:43.226626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4312e-9ee3-4fd8-9573-8aba4fe98239 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:43.226708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4312e-9ee3-4fd8-9573-8aba4fe98239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:43.244225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c7d4312e-9ee3-4fd8-9573-8aba4fe98239 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:43.246156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c7d4312e-9ee3-4fd8-9573-8aba4fe98239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:43.309471 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1299/2593] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:43.320119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:43.321696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:43.373377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:43.392297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a60fd1-5ee7-4a08-864d-cd407e598d52 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:43.396764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b158dfa-2f9e-414c-a26b-b5f871250153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:43.397518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b158dfa-2f9e-414c-a26b-b5f871250153 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:43.397840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b158dfa-2f9e-414c-a26b-b5f871250153 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:43.398131 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b158dfa-2f9e-414c-a26b-b5f871250153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:43.409456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b158dfa-2f9e-414c-a26b-b5f871250153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:43.411611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b158dfa-2f9e-414c-a26b-b5f871250153 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:43.423043 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1295/2594] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:43.702800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4312e-9ee3-4fd8-9573-8aba4fe98239 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:43.704265 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c7d4312e-9ee3-4fd8-9573-8aba4fe98239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:43.716864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4312e-9ee3-4fd8-9573-8aba4fe98239 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:43.721764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:43.723446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:43.723600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:43.723837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] PATH_INFO: `/v3/projects/2bc6125cc77749518bc7aaad780eae43` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:43.725051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc6125cc77749518bc7aaad780eae43)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:43.727006 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:43.774063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc6125cc77749518bc7aaad780eae43', 'request_id': 'req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.779912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc6125cc77749518bc7aaad780eae43', 'request_id': 'req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.787213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc6125cc77749518bc7aaad780eae43', 'request_id': 'req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.797643 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] The token cache is being invalidate because project 2bc6125cc77749518bc7aaad780eae43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:43.797937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.798568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.800104 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1300/2595] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:43 2022] DELETE /identity/v3/projects/2bc6125cc77749518bc7aaad780eae43 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:43.804389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b158dfa-2f9e-414c-a26b-b5f871250153 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:43.814144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b158dfa-2f9e-414c-a26b-b5f871250153 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:43.872811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:43.873766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:43.874084 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:43.874366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] PATH_INFO: `/v3/users/578bea7400614957a192680f7a7ec294` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:43.875733 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=578bea7400614957a192680f7a7ec294)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:43.877640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:43.924511 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578bea7400614957a192680f7a7ec294'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.925159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578bea7400614957a192680f7a7ec294'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.932581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578bea7400614957a192680f7a7ec294'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.945414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578bea7400614957a192680f7a7ec294'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.952256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fffe9510-ec35-4f4f-9f3d-bd76e00afc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578bea7400614957a192680f7a7ec294'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:43.959317 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1296/2596] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:43 2022] DELETE /identity/v3/users/578bea7400614957a192680f7a7ec294 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:44.252150 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:44.254982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:44.271586 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71336a-9a1b-4bd8-a0d0-4dfbe1d9dc69 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:44.305252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:44.338598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:44.339501 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.339796 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.340086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] PATH_INFO: `/v3/projects/dfad2bf9d1a943a7882d365a649a6cfe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.341349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfad2bf9d1a943a7882d365a649a6cfe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:44.343328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:44.392181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfad2bf9d1a943a7882d365a649a6cfe', 'request_id': 'req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:44.398572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfad2bf9d1a943a7882d365a649a6cfe', 'request_id': 'req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:44.406103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfad2bf9d1a943a7882d365a649a6cfe', 'request_id': 'req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:44.420679 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] The token cache is being invalidate because project dfad2bf9d1a943a7882d365a649a6cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:44.420975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:44.421694 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2267b5-e80f-4d8f-9ea9-652a78c61fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:44.423222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1301/2597] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:44 2022] DELETE /identity/v3/projects/dfad2bf9d1a943a7882d365a649a6cfe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:44.428583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974ee1-b8cd-4f9a-a152-587fe8f3327d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.428881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974ee1-b8cd-4f9a-a152-587fe8f3327d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.429198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974ee1-b8cd-4f9a-a152-587fe8f3327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.446685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-15974ee1-b8cd-4f9a-a152-587fe8f3327d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:44.447900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15974ee1-b8cd-4f9a-a152-587fe8f3327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:44.499265 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:44.509050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1297/2598] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:44.516189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b080e5f-d4d0-4d6e-99a5-e216032a6dee None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.516489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b080e5f-d4d0-4d6e-99a5-e216032a6dee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.516779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b080e5f-d4d0-4d6e-99a5-e216032a6dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.535304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7b080e5f-d4d0-4d6e-99a5-e216032a6dee None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:44.536613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7b080e5f-d4d0-4d6e-99a5-e216032a6dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:44.544552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1302/2599] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:44.548610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15974ee1-b8cd-4f9a-a152-587fe8f3327d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:44.559095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15974ee1-b8cd-4f9a-a152-587fe8f3327d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:44.563994 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:44.564662 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.564953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.565238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.566062 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:44.566363 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:44.568026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:44.579632 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1298/2600] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:10:44.583785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b080e5f-d4d0-4d6e-99a5-e216032a6dee None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:44.593000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b080e5f-d4d0-4d6e-99a5-e216032a6dee None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:44.598224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657f4c-5b00-4092-990b-f7190a237015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:44.598869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657f4c-5b00-4092-990b-f7190a237015 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.599160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657f4c-5b00-4092-990b-f7190a237015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.599442 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657f4c-5b00-4092-990b-f7190a237015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.600141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36657f4c-5b00-4092-990b-f7190a237015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:44.602058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36657f4c-5b00-4092-990b-f7190a237015 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:44.627604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1303/2601] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:44 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:44.631766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:44.641860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd3765-5a01-4703-b793-91542d6dd919 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:44.698497 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579cfe4-cac8-4adf-a3dc-ca50779a47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:44.699170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579cfe4-cac8-4adf-a3dc-ca50779a47e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.699463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579cfe4-cac8-4adf-a3dc-ca50779a47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.699747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579cfe4-cac8-4adf-a3dc-ca50779a47e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.700434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579cfe4-cac8-4adf-a3dc-ca50779a47e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:44.702418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579cfe4-cac8-4adf-a3dc-ca50779a47e5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:44.721553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1299/2602] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:44 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:44.726127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657f4c-5b00-4092-990b-f7190a237015 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:44.736138 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657f4c-5b00-4092-990b-f7190a237015 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:44.742079 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6d3ef-ff39-4a88-8113-d0d1503b6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:44.742755 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6d3ef-ff39-4a88-8113-d0d1503b6af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.743042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6d3ef-ff39-4a88-8113-d0d1503b6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.743328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6d3ef-ff39-4a88-8113-d0d1503b6af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.744059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6d3ef-ff39-4a88-8113-d0d1503b6af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:44.745954 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6d3ef-ff39-4a88-8113-d0d1503b6af6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:44.757913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1304/2603] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:44.761909 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579cfe4-cac8-4adf-a3dc-ca50779a47e5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:44.771979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579cfe4-cac8-4adf-a3dc-ca50779a47e5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:44.776660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9e2c-b3ef-421d-b71b-bfb61ea8b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:44.777319 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e2c-b3ef-421d-b71b-bfb61ea8b1cf admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.777652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e2c-b3ef-421d-b71b-bfb61ea8b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.777935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9e2c-b3ef-421d-b71b-bfb61ea8b1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.778664 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9e2c-b3ef-421d-b71b-bfb61ea8b1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:44.780258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9e2c-b3ef-421d-b71b-bfb61ea8b1cf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:44.791002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1300/2604] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:44.795035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6d3ef-ff39-4a88-8113-d0d1503b6af6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:44.805644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6d3ef-ff39-4a88-8113-d0d1503b6af6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:44.810366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c98e7-8426-4e8a-8da8-71a62900d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:44.811196 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c98e7-8426-4e8a-8da8-71a62900d273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.811485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c98e7-8426-4e8a-8da8-71a62900d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.811770 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c98e7-8426-4e8a-8da8-71a62900d273 admin admin] PATH_INFO: `/v3/projects/5d80c34b20da4ea7a361278268116c53/users/746efe16582c49419deacab04da80b4a/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.826157 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c98e7-8426-4e8a-8da8-71a62900d273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d80c34b20da4ea7a361278268116c53, user_id=746efe16582c49419deacab04da80b4a, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:44.828799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c98e7-8426-4e8a-8da8-71a62900d273 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:44.843657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1305/2605] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:44 2022] PUT /identity/v3/projects/5d80c34b20da4ea7a361278268116c53/users/746efe16582c49419deacab04da80b4a/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:44.855977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344701da-922a-4fab-a320-dce7d7d27ef7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:44.856446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344701da-922a-4fab-a320-dce7d7d27ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:44.856542 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344701da-922a-4fab-a320-dce7d7d27ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:44.884540 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-344701da-922a-4fab-a320-dce7d7d27ef7 None None] MFA Rules not processed for user `746efe16582c49419deacab04da80b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:44.885812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-344701da-922a-4fab-a320-dce7d7d27ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:44.957680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1301/2606] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:44.962200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c98e7-8426-4e8a-8da8-71a62900d273 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:45.023504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c98e7-8426-4e8a-8da8-71a62900d273 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:45.028181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9358cd-2868-41b5-823a-337276b05469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:45.028845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9358cd-2868-41b5-823a-337276b05469 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.029136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9358cd-2868-41b5-823a-337276b05469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.029420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9358cd-2868-41b5-823a-337276b05469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.030172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9358cd-2868-41b5-823a-337276b05469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:45.032172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9358cd-2868-41b5-823a-337276b05469 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:45.036747 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:45.059616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1306/2607] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:44 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:45.063754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344701da-922a-4fab-a320-dce7d7d27ef7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:45.074470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344701da-922a-4fab-a320-dce7d7d27ef7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:45.125610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:45.134494 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1c309-e65b-4a3b-a6a1-d2129d8f424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:45.135172 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1c309-e65b-4a3b-a6a1-d2129d8f424c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.135480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1c309-e65b-4a3b-a6a1-d2129d8f424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.135759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1c309-e65b-4a3b-a6a1-d2129d8f424c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.136445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1c309-e65b-4a3b-a6a1-d2129d8f424c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:45.138477 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1c309-e65b-4a3b-a6a1-d2129d8f424c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:45.156953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1302/2608] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:45 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:45.161820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9358cd-2868-41b5-823a-337276b05469 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:45.172460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9358cd-2868-41b5-823a-337276b05469 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:45.178116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f93b27-978b-4e4b-bf31-2d46fec14f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:45.178790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93b27-978b-4e4b-bf31-2d46fec14f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.179077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93b27-978b-4e4b-bf31-2d46fec14f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.179355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93b27-978b-4e4b-bf31-2d46fec14f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.180117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f93b27-978b-4e4b-bf31-2d46fec14f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:45.181753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f93b27-978b-4e4b-bf31-2d46fec14f8c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:45.192345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1307/2609] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:45.196678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1c309-e65b-4a3b-a6a1-d2129d8f424c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:45.207182 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1c309-e65b-4a3b-a6a1-d2129d8f424c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:45.211926 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560c62-6df3-411e-a867-a87dc1b6eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:45.212825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560c62-6df3-411e-a867-a87dc1b6eddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.213111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560c62-6df3-411e-a867-a87dc1b6eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.213391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560c62-6df3-411e-a867-a87dc1b6eddc admin admin] PATH_INFO: `/v3/projects/9f27ded9453d4c698d0663991603d0e5/users/7a8e63d673494e8f8c0f9c832095104c/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.229912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85560c62-6df3-411e-a867-a87dc1b6eddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f27ded9453d4c698d0663991603d0e5, user_id=7a8e63d673494e8f8c0f9c832095104c, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:45.232596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85560c62-6df3-411e-a867-a87dc1b6eddc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:45.246480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1303/2610] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:45 2022] PUT /identity/v3/projects/9f27ded9453d4c698d0663991603d0e5/users/7a8e63d673494e8f8c0f9c832095104c/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:45.250649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f93b27-978b-4e4b-bf31-2d46fec14f8c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:45.260767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f93b27-978b-4e4b-bf31-2d46fec14f8c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:45.316832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a53fd-affe-4312-b659-453a4562fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:45.317430 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a53fd-affe-4312-b659-453a4562fb7b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.317758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a53fd-affe-4312-b659-453a4562fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.318049 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a53fd-affe-4312-b659-453a4562fb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.318777 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a53fd-affe-4312-b659-453a4562fb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:45.320390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a53fd-affe-4312-b659-453a4562fb7b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:45.330438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1308/2611] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:45.338304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560c62-6df3-411e-a867-a87dc1b6eddc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:45.350676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560c62-6df3-411e-a867-a87dc1b6eddc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:45.356347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:45.357248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.359726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.359726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] PATH_INFO: `/v3/projects/9f27ded9453d4c698d0663991603d0e5/users/7a8e63d673494e8f8c0f9c832095104c/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.359952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f27ded9453d4c698d0663991603d0e5, user_id=7a8e63d673494e8f8c0f9c832095104c, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:45.362462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:45.382629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1304/2612] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:45 2022] PUT /identity/v3/projects/9f27ded9453d4c698d0663991603d0e5/users/7a8e63d673494e8f8c0f9c832095104c/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:45.393227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38810-a9e7-4853-be13-4d4cffc7c8e9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.393632 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38810-a9e7-4853-be13-4d4cffc7c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.393995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38810-a9e7-4853-be13-4d4cffc7c8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.426509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b3b38810-a9e7-4853-be13-4d4cffc7c8e9 None None] MFA Rules not processed for user `7a8e63d673494e8f8c0f9c832095104c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:45.427713 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b3b38810-a9e7-4853-be13-4d4cffc7c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:45.501778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1309/2613] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:45.512904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:45.514679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:45.572582 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3291d5-31f6-467f-bf6f-2078285d060b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:45.576232 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:45.576881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.577166 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.577444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.586989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:45.588425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:45.598742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1305/2614] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:45.643252 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b38810-a9e7-4853-be13-4d4cffc7c8e9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:45.645431 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b3b38810-a9e7-4853-be13-4d4cffc7c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:45.657205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b38810-a9e7-4853-be13-4d4cffc7c8e9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:45.661833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fd342-93ff-48c6-9bdc-22ddf409b928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:45.662481 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fd342-93ff-48c6-9bdc-22ddf409b928 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:45.662765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fd342-93ff-48c6-9bdc-22ddf409b928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:45.663040 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fd342-93ff-48c6-9bdc-22ddf409b928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:45.721830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:45.725482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fd342-93ff-48c6-9bdc-22ddf409b928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:45.727352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fd342-93ff-48c6-9bdc-22ddf409b928 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:45.737054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1310/2615] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:48.457241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:48.457241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:48.521252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a6b60-b5f4-481e-9e1e-c15e98b6c793 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:48.525785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:48.526653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:48.526939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:48.527218 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] PATH_INFO: `/v3/users/345155dc9a1349a4b84d3d7ec3fc68d5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:48.528382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345155dc9a1349a4b84d3d7ec3fc68d5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:48.530347 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:48.580367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345155dc9a1349a4b84d3d7ec3fc68d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:48.580950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345155dc9a1349a4b84d3d7ec3fc68d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:48.585173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:48.590609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345155dc9a1349a4b84d3d7ec3fc68d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:48.604418 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345155dc9a1349a4b84d3d7ec3fc68d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:48.611373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345155dc9a1349a4b84d3d7ec3fc68d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:48.617888 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1306/2616] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:48 2022] DELETE /identity/v3/users/345155dc9a1349a4b84d3d7ec3fc68d5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:48.622807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bee73a-4c5c-4d66-bdd2-3ddc002e0ef6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:48.623308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bee73a-4c5c-4d66-bdd2-3ddc002e0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:48.623420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bee73a-4c5c-4d66-bdd2-3ddc002e0ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:48.641050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e6bee73a-4c5c-4d66-bdd2-3ddc002e0ef6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:48.642292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6bee73a-4c5c-4d66-bdd2-3ddc002e0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:48.702399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1311/2617] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:48.712283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:48.713769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:48.774500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26c8f-eb9c-43e0-a19c-6dfa718443f0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:48.779212 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:48.779869 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:48.780154 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:48.780432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:48.790153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:48.791586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:48.801467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1307/2618] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:49.055420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bee73a-4c5c-4d66-bdd2-3ddc002e0ef6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.057413 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6bee73a-4c5c-4d66-bdd2-3ddc002e0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.070564 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bee73a-4c5c-4d66-bdd2-3ddc002e0ef6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.075343 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.076303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.076659 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.077020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] PATH_INFO: `/v3/users/746efe16582c49419deacab04da80b4a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.078368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746efe16582c49419deacab04da80b4a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.080486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.133045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746efe16582c49419deacab04da80b4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.133843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746efe16582c49419deacab04da80b4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.146162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746efe16582c49419deacab04da80b4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.155362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746efe16582c49419deacab04da80b4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.156139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dd5579fd-d820-4240-808b-2a788ef463b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746efe16582c49419deacab04da80b4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.172246 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.173804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.179324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1312/2619] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:49 2022] DELETE /identity/v3/users/746efe16582c49419deacab04da80b4a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:49.184005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f12a8-d245-4f81-9c5e-4579c74a184e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.184309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f12a8-d245-4f81-9c5e-4579c74a184e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.184630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f12a8-d245-4f81-9c5e-4579c74a184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.188693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06addbe-695b-4fb6-b61c-28b2d377606e service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.209293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-396f12a8-d245-4f81-9c5e-4579c74a184e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:49.210561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-396f12a8-d245-4f81-9c5e-4579c74a184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.255059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.255935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.256226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.256510 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] PATH_INFO: `/v3/projects/f43d99d22ef54bbf8eaf5f0f9249773c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.257748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43d99d22ef54bbf8eaf5f0f9249773c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.259669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.271780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1313/2620] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:49.281556 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f12a8-d245-4f81-9c5e-4579c74a184e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.282942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-396f12a8-d245-4f81-9c5e-4579c74a184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.294572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:49.309021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43d99d22ef54bbf8eaf5f0f9249773c', 'request_id': 'req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.317314 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43d99d22ef54bbf8eaf5f0f9249773c', 'request_id': 'req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.323124 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43d99d22ef54bbf8eaf5f0f9249773c', 'request_id': 'req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.335018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] The token cache is being invalidate because project f43d99d22ef54bbf8eaf5f0f9249773c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:49.335338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.336006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa0bf1eb-0f57-4869-a5d8-d8a0703b67ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.337938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1308/2621] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:49 2022] DELETE /identity/v3/projects/f43d99d22ef54bbf8eaf5f0f9249773c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:49.342739 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb23d-4674-404c-907a-97f165c37cb4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.343038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb23d-4674-404c-907a-97f165c37cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.343348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb23d-4674-404c-907a-97f165c37cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.346708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f12a8-d245-4f81-9c5e-4579c74a184e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.351271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:49.366331 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-19ecb23d-4674-404c-907a-97f165c37cb4 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:49.367718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-19ecb23d-4674-404c-907a-97f165c37cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.400599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.401263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.401724 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.402011 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.403855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.429813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1309/2622] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:49.437444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0c50-b2ce-4262-be8f-2d61840977fd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.437768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0c50-b2ce-4262-be8f-2d61840977fd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.438054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0c50-b2ce-4262-be8f-2d61840977fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.456205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1e6f0c50-b2ce-4262-be8f-2d61840977fd None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:49.458024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1e6f0c50-b2ce-4262-be8f-2d61840977fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.466609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1310/2623] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:49.470823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0c50-b2ce-4262-be8f-2d61840977fd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.478299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.479749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.480453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0c50-b2ce-4262-be8f-2d61840977fd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.485199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.485893 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.486186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.486474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.487269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:49.487588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.490217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1314/2624] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:49.490339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.503240 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1311/2625] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:10:49.508918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.519948 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591a5f-62ec-4b60-9d80-e42508a5fecc service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.526191 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543040c-52db-4452-9b74-25649832ca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.526865 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543040c-52db-4452-9b74-25649832ca58 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.527155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543040c-52db-4452-9b74-25649832ca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.527435 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543040c-52db-4452-9b74-25649832ca58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.528133 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543040c-52db-4452-9b74-25649832ca58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.530239 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543040c-52db-4452-9b74-25649832ca58 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.558752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1315/2626] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:49 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:49.563066 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.575122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e32d6f-6e06-4f53-b167-8f63002d966f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.635987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b331cb-fe66-4881-afce-36a6d679734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.636587 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b331cb-fe66-4881-afce-36a6d679734b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.636879 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b331cb-fe66-4881-afce-36a6d679734b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.637164 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b331cb-fe66-4881-afce-36a6d679734b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.637908 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b331cb-fe66-4881-afce-36a6d679734b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.639969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b331cb-fe66-4881-afce-36a6d679734b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.663030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1312/2627] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:49 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:49.666995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543040c-52db-4452-9b74-25649832ca58 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.677995 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543040c-52db-4452-9b74-25649832ca58 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.682660 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5d02-0d06-4b02-8089-d2a1a20c95ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.683333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5d02-0d06-4b02-8089-d2a1a20c95ef admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.683647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5d02-0d06-4b02-8089-d2a1a20c95ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.683925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5d02-0d06-4b02-8089-d2a1a20c95ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.684649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d5d02-0d06-4b02-8089-d2a1a20c95ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.686351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d5d02-0d06-4b02-8089-d2a1a20c95ef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.698794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1316/2628] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:49.710545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b331cb-fe66-4881-afce-36a6d679734b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.720689 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b331cb-fe66-4881-afce-36a6d679734b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.726002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.726808 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.726972 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.727235 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.727978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.729601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.740556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1313/2629] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:49.744697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5d02-0d06-4b02-8089-d2a1a20c95ef admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.755284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5d02-0d06-4b02-8089-d2a1a20c95ef admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.760371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef780055-9c4b-409a-81e6-3dedad46069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.761109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780055-9c4b-409a-81e6-3dedad46069f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.761396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780055-9c4b-409a-81e6-3dedad46069f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.761789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780055-9c4b-409a-81e6-3dedad46069f admin admin] PATH_INFO: `/v3/projects/740bc9af48a84adeb20c57548dfdf8b7/users/944ba415e91a40ed84d4325383eff18e/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.778437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef780055-9c4b-409a-81e6-3dedad46069f admin admin] RBAC: Authorizing `identity:create_grant(project_id=740bc9af48a84adeb20c57548dfdf8b7, user_id=944ba415e91a40ed84d4325383eff18e, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.781146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef780055-9c4b-409a-81e6-3dedad46069f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.792171 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.794391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.810886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb068d-810a-4e96-a0f6-98af40e63f2f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:49.811368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1317/2630] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:49 2022] PUT /identity/v3/projects/740bc9af48a84adeb20c57548dfdf8b7/users/944ba415e91a40ed84d4325383eff18e/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:49.817523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834bed6-05bc-457a-b4ce-383e41457c58 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.817843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834bed6-05bc-457a-b4ce-383e41457c58 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.818233 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834bed6-05bc-457a-b4ce-383e41457c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.839672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2834bed6-05bc-457a-b4ce-383e41457c58 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:49.841033 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2834bed6-05bc-457a-b4ce-383e41457c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.862969 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:49.887627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:49.888509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:49.888798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:49.889114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] PATH_INFO: `/v3/projects/5d80c34b20da4ea7a361278268116c53` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:49.890310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d80c34b20da4ea7a361278268116c53)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:49.892442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:49.895434 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:49.924010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1318/2631] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:49.934513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834bed6-05bc-457a-b4ce-383e41457c58 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.936223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2834bed6-05bc-457a-b4ce-383e41457c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.947498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d80c34b20da4ea7a361278268116c53', 'request_id': 'req-218b5e2e-c173-4eda-a24d-d325157818bf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.955153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d80c34b20da4ea7a361278268116c53', 'request_id': 'req-218b5e2e-c173-4eda-a24d-d325157818bf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.961862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d80c34b20da4ea7a361278268116c53', 'request_id': 'req-218b5e2e-c173-4eda-a24d-d325157818bf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.975184 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] The token cache is being invalidate because project 5d80c34b20da4ea7a361278268116c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:49.975479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.976147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:49.977983 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1314/2632] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:49 2022] DELETE /identity/v3/projects/5d80c34b20da4ea7a361278268116c53 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:49.981953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:49.983276 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:49.997516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834bed6-05bc-457a-b4ce-383e41457c58 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:50.047651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:50.047925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b5e2e-c173-4eda-a24d-d325157818bf admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:50.048362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:50.048656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:50.048936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:50.050756 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:50.053306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:50.054210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:50.054636 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:50.054927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] PATH_INFO: `/v3/users/7a8e63d673494e8f8c0f9c832095104c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:50.056117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8e63d673494e8f8c0f9c832095104c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:50.058594 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:50.063378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:50.064885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:50.075648 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1319/2633] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:50.109400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8e63d673494e8f8c0f9c832095104c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.110112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8e63d673494e8f8c0f9c832095104c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.119292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8e63d673494e8f8c0f9c832095104c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.132677 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8e63d673494e8f8c0f9c832095104c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.140188 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fa2d0260-0e56-450a-b4b9-a9941fedb1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8e63d673494e8f8c0f9c832095104c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.147614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1315/2634] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:49 2022] DELETE /identity/v3/users/7a8e63d673494e8f8c0f9c832095104c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:50.656748 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:50.671872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f2ba-c05e-4b46-86ec-4380180ad18c service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:50.754331 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:50.754925 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:50.755205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:50.755484 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] PATH_INFO: `/v3/projects/9f27ded9453d4c698d0663991603d0e5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:50.756708 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f27ded9453d4c698d0663991603d0e5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:50.758701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:50.789217 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:50.824764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f27ded9453d4c698d0663991603d0e5', 'request_id': 'req-33ce8c93-886c-41fd-a54a-c31af7b2a888'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.831720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f27ded9453d4c698d0663991603d0e5', 'request_id': 'req-33ce8c93-886c-41fd-a54a-c31af7b2a888'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.839383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f27ded9453d4c698d0663991603d0e5', 'request_id': 'req-33ce8c93-886c-41fd-a54a-c31af7b2a888'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.852223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] The token cache is being invalidate because project 9f27ded9453d4c698d0663991603d0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:50.852838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.853558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-33ce8c93-886c-41fd-a54a-c31af7b2a888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:50.855249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1320/2635] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:50 2022] DELETE /identity/v3/projects/9f27ded9453d4c698d0663991603d0e5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:50.860320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f031-ef29-4ed5-9e9b-6e067a4cb082 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:50.860846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f031-ef29-4ed5-9e9b-6e067a4cb082 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:50.860959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188f031-ef29-4ed5-9e9b-6e067a4cb082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:50.881981 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8188f031-ef29-4ed5-9e9b-6e067a4cb082 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:50.883450 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8188f031-ef29-4ed5-9e9b-6e067a4cb082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:50.889427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:50.968998 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1316/2636] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:50.976958 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38b6d-bafa-46b0-ac4a-f9b568d61dc3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:50.977318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38b6d-bafa-46b0-ac4a-f9b568d61dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:50.977640 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38b6d-bafa-46b0-ac4a-f9b568d61dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:50.999131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2ef38b6d-bafa-46b0-ac4a-f9b568d61dc3 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:51.000531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2ef38b6d-bafa-46b0-ac4a-f9b568d61dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:51.013353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe91c9-67bb-4267-a270-8d883214b876 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.013802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe91c9-67bb-4267-a270-8d883214b876 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.013949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1321/2637] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:51.014370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe91c9-67bb-4267-a270-8d883214b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.014725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38b6d-bafa-46b0-ac4a-f9b568d61dc3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.025826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38b6d-bafa-46b0-ac4a-f9b568d61dc3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.031933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.031933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.032196 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.032317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.032994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:51.033306 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.035001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.049086 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1322/2638] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:10:51.055045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.059089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5afe91c9-67bb-4267-a270-8d883214b876 None None] MFA Rules not processed for user `944ba415e91a40ed84d4325383eff18e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:51.060501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5afe91c9-67bb-4267-a270-8d883214b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:51.067292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cefa6d-eb18-4588-a98a-7ec98fd5c758 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.072418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a753637-2f81-41a1-b931-c1ba7e2462a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.073093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753637-2f81-41a1-b931-c1ba7e2462a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.073386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753637-2f81-41a1-b931-c1ba7e2462a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.073703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753637-2f81-41a1-b931-c1ba7e2462a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.074473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a753637-2f81-41a1-b931-c1ba7e2462a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.076354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a753637-2f81-41a1-b931-c1ba7e2462a4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.127638 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1323/2639] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:51 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:51.128533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a753637-2f81-41a1-b931-c1ba7e2462a4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.175244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1317/2640] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:51.180506 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe91c9-67bb-4267-a270-8d883214b876 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.182792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5afe91c9-67bb-4267-a270-8d883214b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:51.206264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe91c9-67bb-4267-a270-8d883214b876 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.221059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a753637-2f81-41a1-b931-c1ba7e2462a4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.227140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16f0dc-46e3-4654-a718-345da38db417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.227840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16f0dc-46e3-4654-a718-345da38db417 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.228131 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16f0dc-46e3-4654-a718-345da38db417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.228416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16f0dc-46e3-4654-a718-345da38db417 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.229120 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16f0dc-46e3-4654-a718-345da38db417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.231122 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16f0dc-46e3-4654-a718-345da38db417 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.259893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1324/2641] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:51 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:51.263794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16f0dc-46e3-4654-a718-345da38db417 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.274625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16f0dc-46e3-4654-a718-345da38db417 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.280164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb4544-d508-4c74-85aa-ecc69174b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.280914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb4544-d508-4c74-85aa-ecc69174b21a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.281277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb4544-d508-4c74-85aa-ecc69174b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.281739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb4544-d508-4c74-85aa-ecc69174b21a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.282479 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb4544-d508-4c74-85aa-ecc69174b21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.284087 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb4544-d508-4c74-85aa-ecc69174b21a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.288358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7afe2-44cf-4d3b-b1f3-407f682526c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.288777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7afe2-44cf-4d3b-b1f3-407f682526c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.289068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7afe2-44cf-4d3b-b1f3-407f682526c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.289354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7afe2-44cf-4d3b-b1f3-407f682526c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.290539 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7afe2-44cf-4d3b-b1f3-407f682526c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.292492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7afe2-44cf-4d3b-b1f3-407f682526c3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.297653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1325/2642] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:51.299342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb4544-d508-4c74-85aa-ecc69174b21a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.311401 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb4544-d508-4c74-85aa-ecc69174b21a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.317027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cd758-33c7-442d-843f-4c6fd9862081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.318050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cd758-33c7-442d-843f-4c6fd9862081 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.318380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cd758-33c7-442d-843f-4c6fd9862081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.318669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cd758-33c7-442d-843f-4c6fd9862081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.319408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cd758-33c7-442d-843f-4c6fd9862081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.321004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1318/2643] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:51 2022] POST /identity/v3/projects => generated 397 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:51.321182 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cd758-33c7-442d-843f-4c6fd9862081 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.325011 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7afe2-44cf-4d3b-b1f3-407f682526c3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.333838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1326/2644] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:51.341667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cd758-33c7-442d-843f-4c6fd9862081 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.351930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cd758-33c7-442d-843f-4c6fd9862081 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.358743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:51.383282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:51.396559 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7afe2-44cf-4d3b-b1f3-407f682526c3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.401842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adc322-f18d-4f9a-be98-7d88f702222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.402525 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adc322-f18d-4f9a-be98-7d88f702222d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.402816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adc322-f18d-4f9a-be98-7d88f702222d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.403101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adc322-f18d-4f9a-be98-7d88f702222d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.403803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adc322-f18d-4f9a-be98-7d88f702222d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.405811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adc322-f18d-4f9a-be98-7d88f702222d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.419537 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5cf0c-b139-48cb-9bd1-1d3fcce4d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.420608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5cf0c-b139-48cb-9bd1-1d3fcce4d381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.420940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5cf0c-b139-48cb-9bd1-1d3fcce4d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.421382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5cf0c-b139-48cb-9bd1-1d3fcce4d381 admin admin] PATH_INFO: `/v3/projects/d3adba9eccb14588947c48159d5e3a23/users/fb1a39be03b04bfe9baebf0f002b96d5/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.430785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1319/2645] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:51 2022] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:51.431913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adc322-f18d-4f9a-be98-7d88f702222d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.437823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5cf0c-b139-48cb-9bd1-1d3fcce4d381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3adba9eccb14588947c48159d5e3a23, user_id=fb1a39be03b04bfe9baebf0f002b96d5, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.440534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5cf0c-b139-48cb-9bd1-1d3fcce4d381 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.441822 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adc322-f18d-4f9a-be98-7d88f702222d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.447253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e57e0-b963-4b0c-9982-ce96cc248139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.447921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e57e0-b963-4b0c-9982-ce96cc248139 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.448294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e57e0-b963-4b0c-9982-ce96cc248139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.448586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e57e0-b963-4b0c-9982-ce96cc248139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.449320 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e57e0-b963-4b0c-9982-ce96cc248139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.450944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e57e0-b963-4b0c-9982-ce96cc248139 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.454190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1327/2646] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:51 2022] PUT /identity/v3/projects/d3adba9eccb14588947c48159d5e3a23/users/fb1a39be03b04bfe9baebf0f002b96d5/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:51.459223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ab8f-94e9-4c47-8331-47d4d83b23b3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.459513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ab8f-94e9-4c47-8331-47d4d83b23b3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.459790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ab8f-94e9-4c47-8331-47d4d83b23b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.461283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1320/2647] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:51.465324 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e57e0-b963-4b0c-9982-ce96cc248139 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.475609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e57e0-b963-4b0c-9982-ce96cc248139 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.480881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1685ab8f-94e9-4c47-8331-47d4d83b23b3 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:51.482109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1685ab8f-94e9-4c47-8331-47d4d83b23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:51.532536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae0ae-6ecd-4586-972b-4f969c142d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.533436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae0ae-6ecd-4586-972b-4f969c142d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.533754 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae0ae-6ecd-4586-972b-4f969c142d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.534040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae0ae-6ecd-4586-972b-4f969c142d29 admin admin] PATH_INFO: `/v3/projects/9ac1d459c7b14f148a8b8f42600db6d3/users/a28eb393c1124f0f9f8e52bf5b15baef/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.544034 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1328/2648] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:51.552599 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ae0ae-6ecd-4586-972b-4f969c142d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac1d459c7b14f148a8b8f42600db6d3, user_id=a28eb393c1124f0f9f8e52bf5b15baef, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.553846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ab8f-94e9-4c47-8331-47d4d83b23b3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.555197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1685ab8f-94e9-4c47-8331-47d4d83b23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:51.555567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ae0ae-6ecd-4586-972b-4f969c142d29 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.569046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1321/2649] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:51 2022] PUT /identity/v3/projects/9ac1d459c7b14f148a8b8f42600db6d3/users/a28eb393c1124f0f9f8e52bf5b15baef/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:51.572855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae0ae-6ecd-4586-972b-4f969c142d29 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.614338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ab8f-94e9-4c47-8331-47d4d83b23b3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.636742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae0ae-6ecd-4586-972b-4f969c142d29 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.641563 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0917998-052a-4d12-9764-80e6ed199c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.642275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0917998-052a-4d12-9764-80e6ed199c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.642576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0917998-052a-4d12-9764-80e6ed199c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.642860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0917998-052a-4d12-9764-80e6ed199c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.643589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0917998-052a-4d12-9764-80e6ed199c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.645786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0917998-052a-4d12-9764-80e6ed199c98 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.656179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1322/2650] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:51.660284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0917998-052a-4d12-9764-80e6ed199c98 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:51.664356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49510141-3296-44f8-92ae-064352aa04f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.665016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510141-3296-44f8-92ae-064352aa04f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.665304 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510141-3296-44f8-92ae-064352aa04f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.665618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49510141-3296-44f8-92ae-064352aa04f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.670874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0917998-052a-4d12-9764-80e6ed199c98 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:51.674736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49510141-3296-44f8-92ae-064352aa04f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.675960 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346a15e-8a9c-4104-ae77-b09e989b9dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:51.676312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49510141-3296-44f8-92ae-064352aa04f9 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.677105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a15e-8a9c-4104-ae77-b09e989b9dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:51.677392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a15e-8a9c-4104-ae77-b09e989b9dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:51.677712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a15e-8a9c-4104-ae77-b09e989b9dd7 admin admin] PATH_INFO: `/v3/projects/9ac1d459c7b14f148a8b8f42600db6d3/users/a28eb393c1124f0f9f8e52bf5b15baef/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:51.679698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346a15e-8a9c-4104-ae77-b09e989b9dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac1d459c7b14f148a8b8f42600db6d3, user_id=a28eb393c1124f0f9f8e52bf5b15baef, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:51.682440 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346a15e-8a9c-4104-ae77-b09e989b9dd7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:51.687409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1329/2651] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:51.693878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1323/2652] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:51 2022] PUT /identity/v3/projects/9ac1d459c7b14f148a8b8f42600db6d3/users/a28eb393c1124f0f9f8e52bf5b15baef/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:52.387181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59bfb-7204-422b-9dd2-14bb6fd5214f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:52.387181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59bfb-7204-422b-9dd2-14bb6fd5214f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:52.387181 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59bfb-7204-422b-9dd2-14bb6fd5214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:52.399779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e0ac6-29d1-44bf-a5c0-dccefc9bf3c2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:52.400340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e0ac6-29d1-44bf-a5c0-dccefc9bf3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:52.400340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e0ac6-29d1-44bf-a5c0-dccefc9bf3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:52.426398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-35c59bfb-7204-422b-9dd2-14bb6fd5214f None None] MFA Rules not processed for user `fb1a39be03b04bfe9baebf0f002b96d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:52.428195 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-35c59bfb-7204-422b-9dd2-14bb6fd5214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:52.432170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:52.434127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:52.443925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-122e0ac6-29d1-44bf-a5c0-dccefc9bf3c2 None None] MFA Rules not processed for user `a28eb393c1124f0f9f8e52bf5b15baef`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:52.446211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-122e0ac6-29d1-44bf-a5c0-dccefc9bf3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:52.535171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1330/2653] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:52.540482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c59bfb-7204-422b-9dd2-14bb6fd5214f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:52.550702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1324/2654] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:52.634596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c59bfb-7204-422b-9dd2-14bb6fd5214f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:52.640786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a2b2e-06c3-4ca2-9de6-e955586318c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:52.641578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2b2e-06c3-4ca2-9de6-e955586318c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:52.642106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2b2e-06c3-4ca2-9de6-e955586318c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:52.642249 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2b2e-06c3-4ca2-9de6-e955586318c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:52.643012 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a2b2e-06c3-4ca2-9de6-e955586318c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:52.645986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a2b2e-06c3-4ca2-9de6-e955586318c6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:52.679688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1331/2655] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:52 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:52.683867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e0ac6-29d1-44bf-a5c0-dccefc9bf3c2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:52.696637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e0ac6-29d1-44bf-a5c0-dccefc9bf3c2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:52.770425 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff44e77-e53f-4523-a4eb-65781426e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:52.771258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44e77-e53f-4523-a4eb-65781426e8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:52.771645 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44e77-e53f-4523-a4eb-65781426e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:52.772050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44e77-e53f-4523-a4eb-65781426e8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:52.772841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff44e77-e53f-4523-a4eb-65781426e8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:52.774921 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff44e77-e53f-4523-a4eb-65781426e8b1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:52.802199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1325/2656] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:52 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:52.804057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a2b2e-06c3-4ca2-9de6-e955586318c6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:52.814715 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a2b2e-06c3-4ca2-9de6-e955586318c6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:52.822140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dca405-d6b2-4c6c-92cd-2728a2e054e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:52.822945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca405-d6b2-4c6c-92cd-2728a2e054e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:52.823335 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca405-d6b2-4c6c-92cd-2728a2e054e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:52.823754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca405-d6b2-4c6c-92cd-2728a2e054e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:52.824607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dca405-d6b2-4c6c-92cd-2728a2e054e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:52.826387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dca405-d6b2-4c6c-92cd-2728a2e054e9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:52.843227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1332/2657] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:52.845087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff44e77-e53f-4523-a4eb-65781426e8b1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:52.859449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff44e77-e53f-4523-a4eb-65781426e8b1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:52.864264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e65d05-1cdf-4519-90ea-d4ad1e62961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:52.865344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e65d05-1cdf-4519-90ea-d4ad1e62961f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:52.866456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e65d05-1cdf-4519-90ea-d4ad1e62961f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:52.866456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e65d05-1cdf-4519-90ea-d4ad1e62961f admin admin] PATH_INFO: `/v3/projects/39b1d230f55340dcbc43c701f0f36612/users/b6f96741f2894e43972c6515ecfbcab2/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:52.896216 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e65d05-1cdf-4519-90ea-d4ad1e62961f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b1d230f55340dcbc43c701f0f36612, user_id=b6f96741f2894e43972c6515ecfbcab2, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:52.899699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e65d05-1cdf-4519-90ea-d4ad1e62961f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:52.919071 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1326/2658] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:52 2022] PUT /identity/v3/projects/39b1d230f55340dcbc43c701f0f36612/users/b6f96741f2894e43972c6515ecfbcab2/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:52.920036 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dca405-d6b2-4c6c-92cd-2728a2e054e9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:52.931825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dca405-d6b2-4c6c-92cd-2728a2e054e9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:52.999494 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e3493-8fa3-45e3-82f2-f106d9047622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:53.000187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3493-8fa3-45e3-82f2-f106d9047622 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:53.001016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3493-8fa3-45e3-82f2-f106d9047622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:53.001300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3493-8fa3-45e3-82f2-f106d9047622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:53.002117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e3493-8fa3-45e3-82f2-f106d9047622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:53.003736 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e3493-8fa3-45e3-82f2-f106d9047622 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:53.023480 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1333/2659] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:53.027475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e65d05-1cdf-4519-90ea-d4ad1e62961f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:53.039004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e65d05-1cdf-4519-90ea-d4ad1e62961f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:53.045414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3738-5511-4027-a197-ad95f3848fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:53.048374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3738-5511-4027-a197-ad95f3848fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:53.048779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3738-5511-4027-a197-ad95f3848fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:53.049237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3738-5511-4027-a197-ad95f3848fc7 admin admin] PATH_INFO: `/v3/projects/39b1d230f55340dcbc43c701f0f36612/users/b6f96741f2894e43972c6515ecfbcab2/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:53.052877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf3738-5511-4027-a197-ad95f3848fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b1d230f55340dcbc43c701f0f36612, user_id=b6f96741f2894e43972c6515ecfbcab2, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:53.056936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf3738-5511-4027-a197-ad95f3848fc7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:53.071332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1327/2660] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:53 2022] PUT /identity/v3/projects/39b1d230f55340dcbc43c701f0f36612/users/b6f96741f2894e43972c6515ecfbcab2/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:54.522599 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e3493-8fa3-45e3-82f2-f106d9047622 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:54.533348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e3493-8fa3-45e3-82f2-f106d9047622 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:54.553445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:54.578458 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947d270-0944-4a7a-8e59-03012c35724d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:54.578988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947d270-0944-4a7a-8e59-03012c35724d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:54.579090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947d270-0944-4a7a-8e59-03012c35724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:54.606207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f947d270-0944-4a7a-8e59-03012c35724d None None] MFA Rules not processed for user `b6f96741f2894e43972c6515ecfbcab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:54.607856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f947d270-0944-4a7a-8e59-03012c35724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:54.611933 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:54.612862 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:54.613154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:54.614121 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] PATH_INFO: `/v3/users/944ba415e91a40ed84d4325383eff18e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:54.615467 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944ba415e91a40ed84d4325383eff18e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:54.617945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:54.658400 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:54.675362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944ba415e91a40ed84d4325383eff18e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:54.676832 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944ba415e91a40ed84d4325383eff18e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:54.684572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944ba415e91a40ed84d4325383eff18e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:54.695640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1328/2661] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:54.697436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944ba415e91a40ed84d4325383eff18e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:54.698310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944ba415e91a40ed84d4325383eff18e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:54.707498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947d270-0944-4a7a-8e59-03012c35724d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:54.709659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f947d270-0944-4a7a-8e59-03012c35724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:54.732053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1334/2662] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:54 2022] DELETE /identity/v3/users/944ba415e91a40ed84d4325383eff18e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:54.803930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947d270-0944-4a7a-8e59-03012c35724d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:54.865060 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:54.865653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:54.866074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:54.866358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:54.868423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:54.947587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:54.948988 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:54.955609 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:54.957489 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:54.968035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1329/2663] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:55.046757 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7f3b5-db5e-4f1d-acbb-546ff62e3814 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:55.052848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:55.053878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:55.054297 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:55.054601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] PATH_INFO: `/v3/projects/740bc9af48a84adeb20c57548dfdf8b7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:55.055872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] RBAC: Authorizing `identity:delete_project(project_id=740bc9af48a84adeb20c57548dfdf8b7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:55.058136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:55.100861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:55.114262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740bc9af48a84adeb20c57548dfdf8b7', 'request_id': 'req-36263601-a71b-4449-acb4-a125a0be588c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.126754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740bc9af48a84adeb20c57548dfdf8b7', 'request_id': 'req-36263601-a71b-4449-acb4-a125a0be588c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.135979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740bc9af48a84adeb20c57548dfdf8b7', 'request_id': 'req-36263601-a71b-4449-acb4-a125a0be588c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.150783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] The token cache is being invalidate because project 740bc9af48a84adeb20c57548dfdf8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:55.151174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.152072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.157389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1335/2664] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:54 2022] DELETE /identity/v3/projects/740bc9af48a84adeb20c57548dfdf8b7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:55.158315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:55.173036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0236b0a-8b87-4f0d-83bf-c66a8057c1b6 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:55.230627 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:55.254119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:55.254119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:55.254119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:55.254119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] PATH_INFO: `/v3/users/a28eb393c1124f0f9f8e52bf5b15baef` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:55.255280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28eb393c1124f0f9f8e52bf5b15baef)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:55.257069 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:55.332179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28eb393c1124f0f9f8e52bf5b15baef'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.333671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28eb393c1124f0f9f8e52bf5b15baef'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.345050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28eb393c1124f0f9f8e52bf5b15baef'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.364439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28eb393c1124f0f9f8e52bf5b15baef'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.373231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bb90bab-5df9-42a9-8428-782fcd773471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28eb393c1124f0f9f8e52bf5b15baef'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.380140 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1330/2665] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:10:55 2022] DELETE /identity/v3/users/a28eb393c1124f0f9f8e52bf5b15baef => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:55.574758 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:55.576270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:55.595799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36263601-a71b-4449-acb4-a125a0be588c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:55.654032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:55.655185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:55.655477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:55.655763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] PATH_INFO: `/v3/projects/9ac1d459c7b14f148a8b8f42600db6d3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:55.656952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac1d459c7b14f148a8b8f42600db6d3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:55.659490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:55.705688 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac1d459c7b14f148a8b8f42600db6d3', 'request_id': 'req-5c174612-f985-4333-8e57-417a1bc84ea6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.711963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac1d459c7b14f148a8b8f42600db6d3', 'request_id': 'req-5c174612-f985-4333-8e57-417a1bc84ea6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.719327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac1d459c7b14f148a8b8f42600db6d3', 'request_id': 'req-5c174612-f985-4333-8e57-417a1bc84ea6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.730206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] The token cache is being invalidate because project 9ac1d459c7b14f148a8b8f42600db6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:10:55.730499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.731140 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c174612-f985-4333-8e57-417a1bc84ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:10:55.732695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1336/2666] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:10:55 2022] DELETE /identity/v3/projects/9ac1d459c7b14f148a8b8f42600db6d3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:55.737640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab9fb-6708-46b1-99b7-95cb24f8fcd6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:55.738104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab9fb-6708-46b1-99b7-95cb24f8fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:55.738229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab9fb-6708-46b1-99b7-95cb24f8fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:55.757008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9a1ab9fb-6708-46b1-99b7-95cb24f8fcd6 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:55.758283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9a1ab9fb-6708-46b1-99b7-95cb24f8fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:55.818441 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1331/2667] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:55.825967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaab18-3385-418d-aaec-bc722722ed58 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:55.826262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaab18-3385-418d-aaec-bc722722ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:55.826550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaab18-3385-418d-aaec-bc722722ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:55.844550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8beaab18-3385-418d-aaec-bc722722ed58 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:55.845786 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8beaab18-3385-418d-aaec-bc722722ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:55.854293 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1337/2668] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:55.858851 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ab9fb-6708-46b1-99b7-95cb24f8fcd6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:55.869369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ab9fb-6708-46b1-99b7-95cb24f8fcd6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:55.874904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:55.875566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:55.875853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:55.876138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:55.876874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:10:55.877196 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:55.878881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:55.890789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1332/2669] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:10:55.895349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaab18-3385-418d-aaec-bc722722ed58 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:55.904576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaab18-3385-418d-aaec-bc722722ed58 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:55.909245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96442-54e7-4ef9-87ee-9a2dcecf7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:55.909940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96442-54e7-4ef9-87ee-9a2dcecf7568 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:55.910787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96442-54e7-4ef9-87ee-9a2dcecf7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:55.911017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96442-54e7-4ef9-87ee-9a2dcecf7568 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:55.911733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96442-54e7-4ef9-87ee-9a2dcecf7568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:55.913635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96442-54e7-4ef9-87ee-9a2dcecf7568 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:55.939901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1338/2670] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:55 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:10:55.944280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:55.954514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5595e-f60e-4371-a2ac-58f40445467a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.002355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:56.013391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf96c-5e3e-4565-b64d-f06e10dde8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.014095 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf96c-5e3e-4565-b64d-f06e10dde8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.014386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf96c-5e3e-4565-b64d-f06e10dde8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.014670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf96c-5e3e-4565-b64d-f06e10dde8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.015376 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf96c-5e3e-4565-b64d-f06e10dde8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.017361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf96c-5e3e-4565-b64d-f06e10dde8c0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.041570 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1333/2671] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:55 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:56.042819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96442-54e7-4ef9-87ee-9a2dcecf7568 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.053110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96442-54e7-4ef9-87ee-9a2dcecf7568 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.057752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164620f-0d89-406e-b307-1524286ab64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.058767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164620f-0d89-406e-b307-1524286ab64e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.059057 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164620f-0d89-406e-b307-1524286ab64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.059342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164620f-0d89-406e-b307-1524286ab64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.060071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164620f-0d89-406e-b307-1524286ab64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.061725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164620f-0d89-406e-b307-1524286ab64e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.072026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1339/2672] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:56.075880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf96c-5e3e-4565-b64d-f06e10dde8c0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.086512 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf96c-5e3e-4565-b64d-f06e10dde8c0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.091378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d75a1-ca6a-4f3f-8160-b0c25253425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.092046 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d75a1-ca6a-4f3f-8160-b0c25253425e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.092337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d75a1-ca6a-4f3f-8160-b0c25253425e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.092622 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d75a1-ca6a-4f3f-8160-b0c25253425e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.093402 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d75a1-ca6a-4f3f-8160-b0c25253425e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.095113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d75a1-ca6a-4f3f-8160-b0c25253425e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.105904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1334/2673] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:56.109686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164620f-0d89-406e-b307-1524286ab64e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.119602 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164620f-0d89-406e-b307-1524286ab64e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.124693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbd190-1061-4022-a606-abd47c55fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.125600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbd190-1061-4022-a606-abd47c55fa68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.125887 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbd190-1061-4022-a606-abd47c55fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.126171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbd190-1061-4022-a606-abd47c55fa68 admin admin] PATH_INFO: `/v3/projects/1fd67e8030b84fa2b5e00d66b5d5ddfa/users/935a5730c5714709b13e8651b704a96c/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.137808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:56.141223 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbd190-1061-4022-a606-abd47c55fa68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd67e8030b84fa2b5e00d66b5d5ddfa, user_id=935a5730c5714709b13e8651b704a96c, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.144986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbd190-1061-4022-a606-abd47c55fa68 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.158386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1340/2674] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:56 2022] PUT /identity/v3/projects/1fd67e8030b84fa2b5e00d66b5d5ddfa/users/935a5730c5714709b13e8651b704a96c/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:56.169354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7228a2e-336d-4e46-bd68-5aa52016a44d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.169708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7228a2e-336d-4e46-bd68-5aa52016a44d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.170001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7228a2e-336d-4e46-bd68-5aa52016a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.199982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a7228a2e-336d-4e46-bd68-5aa52016a44d None None] MFA Rules not processed for user `935a5730c5714709b13e8651b704a96c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:56.201536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a7228a2e-336d-4e46-bd68-5aa52016a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:56.267128 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1335/2675] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:10:56.272209 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbd190-1061-4022-a606-abd47c55fa68 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.333322 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbd190-1061-4022-a606-abd47c55fa68 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.338137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.338808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.339102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.339387 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.340099 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.342051 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.368877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1341/2676] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:10:56 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:56.373074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7228a2e-336d-4e46-bd68-5aa52016a44d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.384520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7228a2e-336d-4e46-bd68-5aa52016a44d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.389763 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.391478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:56.451145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35e2c2-2b37-465c-95a7-ef1a41e7b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.451832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35e2c2-2b37-465c-95a7-ef1a41e7b02d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.452155 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35e2c2-2b37-465c-95a7-ef1a41e7b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.452443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35e2c2-2b37-465c-95a7-ef1a41e7b02d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.453156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35e2c2-2b37-465c-95a7-ef1a41e7b02d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.455156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35e2c2-2b37-465c-95a7-ef1a41e7b02d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.459218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c1f2-1d42-4b1b-93c1-1342cf86045e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.462914 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.463595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.463881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.464154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.465982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:56.475928 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1336/2677] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:10:56 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:10:56.479845 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35e2c2-2b37-465c-95a7-ef1a41e7b02d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.489859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35e2c2-2b37-465c-95a7-ef1a41e7b02d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.494644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae573a-032b-4820-bd53-59ebea49d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.495553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae573a-032b-4820-bd53-59ebea49d879 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.495844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae573a-032b-4820-bd53-59ebea49d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.496165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae573a-032b-4820-bd53-59ebea49d879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.496891 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae573a-032b-4820-bd53-59ebea49d879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.498519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae573a-032b-4820-bd53-59ebea49d879 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.509428 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1337/2678] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:10:56.513269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae573a-032b-4820-bd53-59ebea49d879 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.523624 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae573a-032b-4820-bd53-59ebea49d879 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.528185 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff378c-a3a2-4ed1-b363-26024a68ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.529038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff378c-a3a2-4ed1-b363-26024a68ef60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.529322 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff378c-a3a2-4ed1-b363-26024a68ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.529631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff378c-a3a2-4ed1-b363-26024a68ef60 admin admin] PATH_INFO: `/v3/projects/3eef37e4349145bea9d4f5cb7e756fba/users/8740c8c30ecf43af9cd02a64b4898191/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.536652 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.538156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.544345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff378c-a3a2-4ed1-b363-26024a68ef60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eef37e4349145bea9d4f5cb7e756fba, user_id=8740c8c30ecf43af9cd02a64b4898191, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.546995 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff378c-a3a2-4ed1-b363-26024a68ef60 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.548073 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1342/2679] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:10:56.565167 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1338/2680] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:56 2022] PUT /identity/v3/projects/3eef37e4349145bea9d4f5cb7e756fba/users/8740c8c30ecf43af9cd02a64b4898191/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:10:56.569893 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.580420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f441fe-21f4-4a1e-9229-5f1e52213f9c service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.606971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:56.645156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68931d28-bc45-438f-8547-76f55b490527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.645726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931d28-bc45-438f-8547-76f55b490527 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.646010 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931d28-bc45-438f-8547-76f55b490527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.646409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931d28-bc45-438f-8547-76f55b490527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.647263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68931d28-bc45-438f-8547-76f55b490527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.648873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68931d28-bc45-438f-8547-76f55b490527 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.659329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1343/2681] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:10:56.666725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff378c-a3a2-4ed1-b363-26024a68ef60 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.677336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff378c-a3a2-4ed1-b363-26024a68ef60 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.682018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e6ec-e781-439a-a35a-a1a523858145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.682903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e6ec-e781-439a-a35a-a1a523858145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.683190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e6ec-e781-439a-a35a-a1a523858145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.683470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e6ec-e781-439a-a35a-a1a523858145 admin admin] PATH_INFO: `/v3/projects/3eef37e4349145bea9d4f5cb7e756fba/users/8740c8c30ecf43af9cd02a64b4898191/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.685465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4e6ec-e781-439a-a35a-a1a523858145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eef37e4349145bea9d4f5cb7e756fba, user_id=8740c8c30ecf43af9cd02a64b4898191, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.688179 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4e6ec-e781-439a-a35a-a1a523858145 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.695730 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:10:56.700340 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1339/2682] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:10:56 2022] PUT /identity/v3/projects/3eef37e4349145bea9d4f5cb7e756fba/users/8740c8c30ecf43af9cd02a64b4898191/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:10:56.713094 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026239d-7720-467e-9cbd-b2c2c31601b6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.713383 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026239d-7720-467e-9cbd-b2c2c31601b6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.713702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026239d-7720-467e-9cbd-b2c2c31601b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.744622 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c026239d-7720-467e-9cbd-b2c2c31601b6 None None] MFA Rules not processed for user `8740c8c30ecf43af9cd02a64b4898191`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:10:56.746139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c026239d-7720-467e-9cbd-b2c2c31601b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:10:56.817571 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1344/2683] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:10:56.828626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e6ec-e781-439a-a35a-a1a523858145 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.885454 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e6ec-e781-439a-a35a-a1a523858145 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.889081 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128aa89-e53b-4856-ae59-6298bf7e2060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.889768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128aa89-e53b-4856-ae59-6298bf7e2060 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.890058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128aa89-e53b-4856-ae59-6298bf7e2060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.890343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128aa89-e53b-4856-ae59-6298bf7e2060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:56.899598 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128aa89-e53b-4856-ae59-6298bf7e2060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:56.901055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128aa89-e53b-4856-ae59-6298bf7e2060 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:56.910696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1340/2684] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:10:56.980695 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026239d-7720-467e-9cbd-b2c2c31601b6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:10:56.991078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026239d-7720-467e-9cbd-b2c2c31601b6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:10:56.994731 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:10:56.995628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:10:56.995916 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:10:56.996197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:10:57.052642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:10:57.054118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:10:57.062994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1345/2685] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:10:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:11:00.559085 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cea5f-2bf1-48b5-865d-abe17f9fd877 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:00.559596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cea5f-2bf1-48b5-865d-abe17f9fd877 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:00.559596 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cea5f-2bf1-48b5-865d-abe17f9fd877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:00.580475 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fc1cea5f-2bf1-48b5-865d-abe17f9fd877 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:00.583817 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fc1cea5f-2bf1-48b5-865d-abe17f9fd877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:00.656123 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1341/2686] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:11:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:00.706610 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:00.708149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:00.758682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:00.781266 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a048d-3d4a-4e6f-8b2b-b82a5b6ed4b0 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:00.786846 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ac8bb-cc7d-4b04-8ed6-301bc8853578 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:00.787515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ac8bb-cc7d-4b04-8ed6-301bc8853578 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:00.787806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ac8bb-cc7d-4b04-8ed6-301bc8853578 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:00.788092 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ac8bb-cc7d-4b04-8ed6-301bc8853578 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:00.796980 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ac8bb-cc7d-4b04-8ed6-301bc8853578 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:00.798635 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ac8bb-cc7d-4b04-8ed6-301bc8853578 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:00.807539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1346/2687] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:11:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 13:11:10.645379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=51 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:10.804288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=11 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:17.860189 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cea5f-2bf1-48b5-865d-abe17f9fd877 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:17.861663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fc1cea5f-2bf1-48b5-865d-abe17f9fd877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:17.927590 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cea5f-2bf1-48b5-865d-abe17f9fd877 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:17.932307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:17.933186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:17.933476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:17.933790 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] PATH_INFO: `/v3/users/fb1a39be03b04bfe9baebf0f002b96d5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:17.935049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1a39be03b04bfe9baebf0f002b96d5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:17.937569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:17.984684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1a39be03b04bfe9baebf0f002b96d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:17.985338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1a39be03b04bfe9baebf0f002b96d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:17.992947 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1a39be03b04bfe9baebf0f002b96d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.007003 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1a39be03b04bfe9baebf0f002b96d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.014146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56da625c-025c-44c8-adfb-734f1d0f1ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1a39be03b04bfe9baebf0f002b96d5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.020367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1342/2688] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:11:17 2022] DELETE /identity/v3/users/fb1a39be03b04bfe9baebf0f002b96d5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:18.191701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ac8bb-cc7d-4b04-8ed6-301bc8853578 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:18.203787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ac8bb-cc7d-4b04-8ed6-301bc8853578 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:18.266611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:18.267489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:18.267780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:18.268069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] PATH_INFO: `/v3/projects/d3adba9eccb14588947c48159d5e3a23` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:18.269441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3adba9eccb14588947c48159d5e3a23)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:18.271389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:18.283647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fe83-ce0a-4a43-870e-3b56004a1b69 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:18.283946 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fe83-ce0a-4a43-870e-3b56004a1b69 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:18.284288 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fe83-ce0a-4a43-870e-3b56004a1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:18.303333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ebc9fe83-ce0a-4a43-870e-3b56004a1b69 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:18.304562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ebc9fe83-ce0a-4a43-870e-3b56004a1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:18.324308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3adba9eccb14588947c48159d5e3a23', 'request_id': 'req-e23a0cfc-aaef-41ff-b99a-9d68ac879616'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.330528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3adba9eccb14588947c48159d5e3a23', 'request_id': 'req-e23a0cfc-aaef-41ff-b99a-9d68ac879616'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.338382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3adba9eccb14588947c48159d5e3a23', 'request_id': 'req-e23a0cfc-aaef-41ff-b99a-9d68ac879616'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.350781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] The token cache is being invalidate because project d3adba9eccb14588947c48159d5e3a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:11:18.351095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.351726 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.353334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1347/2689] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:11:18 2022] DELETE /identity/v3/projects/d3adba9eccb14588947c48159d5e3a23 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:18.357187 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:18.358598 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:18.366864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1343/2690] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 8 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:11:18.379769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9fe83-ce0a-4a43-870e-3b56004a1b69 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:18.381153 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ebc9fe83-ce0a-4a43-870e-3b56004a1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:18.409015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:18.436425 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0cfc-aaef-41ff-b99a-9d68ac879616 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:18.441478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:18.442422 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:18.442706 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:18.442986 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] PATH_INFO: `/v3/users/b6f96741f2894e43972c6515ecfbcab2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:18.444186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f96741f2894e43972c6515ecfbcab2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:18.446130 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:18.456823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9fe83-ce0a-4a43-870e-3b56004a1b69 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:18.481562 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:18.497351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f96741f2894e43972c6515ecfbcab2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.498063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f96741f2894e43972c6515ecfbcab2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.505996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f96741f2894e43972c6515ecfbcab2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.514302 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f96741f2894e43972c6515ecfbcab2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.515008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f96741f2894e43972c6515ecfbcab2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.525010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6dc6c-ca27-4b36-b142-25dcf028b76b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:18.525832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6dc6c-ca27-4b36-b142-25dcf028b76b service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:18.526336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6dc6c-ca27-4b36-b142-25dcf028b76b service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:18.526682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6dc6c-ca27-4b36-b142-25dcf028b76b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:18.529444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e9b6dc6c-ca27-4b36-b142-25dcf028b76b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:18.534106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1348/2691] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:11:18 2022] DELETE /identity/v3/users/b6f96741f2894e43972c6515ecfbcab2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:11:18.593059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6dc6c-ca27-4b36-b142-25dcf028b76b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:18.594857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6dc6c-ca27-4b36-b142-25dcf028b76b service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:18.604122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1344/2692] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 13:11:18.729851 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:18.731611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:18.837245 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe216c-c88f-48da-88c9-19a818522abe admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:18.842674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:18.843841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:18.844207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:18.844666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] PATH_INFO: `/v3/projects/39b1d230f55340dcbc43c701f0f36612` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:18.846089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b1d230f55340dcbc43c701f0f36612)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:18.849001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:18.912674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b1d230f55340dcbc43c701f0f36612', 'request_id': 'req-bc499869-bbd1-4cbc-925a-6eb5747d349d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.919309 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b1d230f55340dcbc43c701f0f36612', 'request_id': 'req-bc499869-bbd1-4cbc-925a-6eb5747d349d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.926809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b1d230f55340dcbc43c701f0f36612', 'request_id': 'req-bc499869-bbd1-4cbc-925a-6eb5747d349d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.943446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] The token cache is being invalidate because project 39b1d230f55340dcbc43c701f0f36612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:11:18.943743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.944406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bc499869-bbd1-4cbc-925a-6eb5747d349d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:18.946172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1349/2693] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:11:18 2022] DELETE /identity/v3/projects/39b1d230f55340dcbc43c701f0f36612 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:18.951996 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a7b6-fda1-40fa-8249-b23b6ba25823 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:18.952454 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a7b6-fda1-40fa-8249-b23b6ba25823 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:18.952552 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a7b6-fda1-40fa-8249-b23b6ba25823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:18.971252 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6b47a7b6-fda1-40fa-8249-b23b6ba25823 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:18.972731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6b47a7b6-fda1-40fa-8249-b23b6ba25823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:19.044843 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1345/2694] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:19.053761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379f6f8-b0b4-4e3e-ab71-3f8c7fb678ef None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.054061 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379f6f8-b0b4-4e3e-ab71-3f8c7fb678ef None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.054352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379f6f8-b0b4-4e3e-ab71-3f8c7fb678ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.073072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d379f6f8-b0b4-4e3e-ab71-3f8c7fb678ef None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:19.074320 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d379f6f8-b0b4-4e3e-ab71-3f8c7fb678ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:19.083263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1350/2695] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:19.087742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a7b6-fda1-40fa-8249-b23b6ba25823 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.097919 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a7b6-fda1-40fa-8249-b23b6ba25823 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.102473 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.103127 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.103411 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.103688 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.104409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:11:19.104718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.106452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.108805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:19.121514 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1346/2696] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:11:19.131341 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379f6f8-b0b4-4e3e-ab71-3f8c7fb678ef None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.141155 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379f6f8-b0b4-4e3e-ab71-3f8c7fb678ef None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.147190 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f74a4-c6be-4105-a39a-42a9cb295585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.148066 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f74a4-c6be-4105-a39a-42a9cb295585 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.148363 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f74a4-c6be-4105-a39a-42a9cb295585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.148644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f74a4-c6be-4105-a39a-42a9cb295585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.149340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f74a4-c6be-4105-a39a-42a9cb295585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.151265 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f74a4-c6be-4105-a39a-42a9cb295585 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.177342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1351/2697] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:11:19 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:11:19.181564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.195383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d0b67-eb09-4127-9fe6-6f5269fdfedd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.255531 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad550bd-ad2c-4173-bd69-4c9931feb08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.256205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad550bd-ad2c-4173-bd69-4c9931feb08e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.256496 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad550bd-ad2c-4173-bd69-4c9931feb08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.256777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad550bd-ad2c-4173-bd69-4c9931feb08e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.257464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad550bd-ad2c-4173-bd69-4c9931feb08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.259430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad550bd-ad2c-4173-bd69-4c9931feb08e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.279647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1347/2698] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:11:19 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:11:19.283672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f74a4-c6be-4105-a39a-42a9cb295585 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.294132 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f74a4-c6be-4105-a39a-42a9cb295585 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.298852 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c44751-7ed1-47a5-aaba-be4dac6fc3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.299519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44751-7ed1-47a5-aaba-be4dac6fc3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.299809 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44751-7ed1-47a5-aaba-be4dac6fc3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.300093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44751-7ed1-47a5-aaba-be4dac6fc3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.301344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c44751-7ed1-47a5-aaba-be4dac6fc3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.303003 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c44751-7ed1-47a5-aaba-be4dac6fc3a1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.308148 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:19.314283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1352/2699] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:19.321601 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad550bd-ad2c-4173-bd69-4c9931feb08e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.332652 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad550bd-ad2c-4173-bd69-4c9931feb08e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.337841 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21e154-6c79-4ad1-ac9f-b318e8834920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.338509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21e154-6c79-4ad1-ac9f-b318e8834920 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.338802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21e154-6c79-4ad1-ac9f-b318e8834920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.339080 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21e154-6c79-4ad1-ac9f-b318e8834920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.339807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21e154-6c79-4ad1-ac9f-b318e8834920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.341389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21e154-6c79-4ad1-ac9f-b318e8834920 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.351585 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1348/2700] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:19.355930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c44751-7ed1-47a5-aaba-be4dac6fc3a1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.366448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c44751-7ed1-47a5-aaba-be4dac6fc3a1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.371359 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29a08-0626-4bb0-9b05-744745c830f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.372250 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29a08-0626-4bb0-9b05-744745c830f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.372538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29a08-0626-4bb0-9b05-744745c830f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.372823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29a08-0626-4bb0-9b05-744745c830f5 admin admin] PATH_INFO: `/v3/projects/a12b0c9057194d5d88785e2af29ddf1c/users/d03cd4e8e8634635bf6de824481d3783/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.389458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d29a08-0626-4bb0-9b05-744745c830f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12b0c9057194d5d88785e2af29ddf1c, user_id=d03cd4e8e8634635bf6de824481d3783, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.392156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d29a08-0626-4bb0-9b05-744745c830f5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.406382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1353/2701] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:11:19 2022] PUT /identity/v3/projects/a12b0c9057194d5d88785e2af29ddf1c/users/d03cd4e8e8634635bf6de824481d3783/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:19.417523 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf77f-c5a9-40fd-9d30-87cab20fc7a2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.417846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf77f-c5a9-40fd-9d30-87cab20fc7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.418132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf77f-c5a9-40fd-9d30-87cab20fc7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.445575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-702cf77f-c5a9-40fd-9d30-87cab20fc7a2 None None] MFA Rules not processed for user `d03cd4e8e8634635bf6de824481d3783`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:19.446828 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-702cf77f-c5a9-40fd-9d30-87cab20fc7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:19.510742 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1349/2702] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:19.515170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29a08-0626-4bb0-9b05-744745c830f5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.576350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29a08-0626-4bb0-9b05-744745c830f5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.581089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84936056-df2d-471c-a3ec-d190c6995f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.582288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936056-df2d-471c-a3ec-d190c6995f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.582575 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936056-df2d-471c-a3ec-d190c6995f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.582860 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936056-df2d-471c-a3ec-d190c6995f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.583549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84936056-df2d-471c-a3ec-d190c6995f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.585433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84936056-df2d-471c-a3ec-d190c6995f55 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.611353 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1354/2703] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:11:19 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:11:19.615626 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cf77f-c5a9-40fd-9d30-87cab20fc7a2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.626665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cf77f-c5a9-40fd-9d30-87cab20fc7a2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.694284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddfea7-e223-43a2-a6c7-cc2da760e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.694997 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddfea7-e223-43a2-a6c7-cc2da760e6ee admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.695281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddfea7-e223-43a2-a6c7-cc2da760e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.695567 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddfea7-e223-43a2-a6c7-cc2da760e6ee admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.696293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddfea7-e223-43a2-a6c7-cc2da760e6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.698270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddfea7-e223-43a2-a6c7-cc2da760e6ee admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.707806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:19.719763 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1350/2704] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:11:19 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:11:19.723984 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84936056-df2d-471c-a3ec-d190c6995f55 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.734332 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84936056-df2d-471c-a3ec-d190c6995f55 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.739185 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef659d-c633-4c8b-96ad-99e42a53e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.739845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef659d-c633-4c8b-96ad-99e42a53e776 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.740162 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef659d-c633-4c8b-96ad-99e42a53e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.740446 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef659d-c633-4c8b-96ad-99e42a53e776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.741173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef659d-c633-4c8b-96ad-99e42a53e776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.742814 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef659d-c633-4c8b-96ad-99e42a53e776 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.754890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1355/2705] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:19.758783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddfea7-e223-43a2-a6c7-cc2da760e6ee admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.768883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddfea7-e223-43a2-a6c7-cc2da760e6ee admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.774138 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b77037-1938-4f84-ad69-6927d8bac24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.775023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77037-1938-4f84-ad69-6927d8bac24f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.775313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77037-1938-4f84-ad69-6927d8bac24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.775593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77037-1938-4f84-ad69-6927d8bac24f admin admin] PATH_INFO: `/v3/projects/e1efd598be0040348685dfe4ffa3e551/users/8ee2d382e6a94533847b4ad62ec15131/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.790491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b77037-1938-4f84-ad69-6927d8bac24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1efd598be0040348685dfe4ffa3e551, user_id=8ee2d382e6a94533847b4ad62ec15131, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.793170 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b77037-1938-4f84-ad69-6927d8bac24f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.806090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1351/2706] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:11:19 2022] PUT /identity/v3/projects/e1efd598be0040348685dfe4ffa3e551/users/8ee2d382e6a94533847b4ad62ec15131/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:19.810351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef659d-c633-4c8b-96ad-99e42a53e776 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.820819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef659d-c633-4c8b-96ad-99e42a53e776 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.875549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf40106-95ed-4813-8d10-c6be964ee741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.876139 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf40106-95ed-4813-8d10-c6be964ee741 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.876428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf40106-95ed-4813-8d10-c6be964ee741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.876794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf40106-95ed-4813-8d10-c6be964ee741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.877520 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf40106-95ed-4813-8d10-c6be964ee741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.879666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf40106-95ed-4813-8d10-c6be964ee741 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.889491 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1356/2707] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:19.893638 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b77037-1938-4f84-ad69-6927d8bac24f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:19.904759 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b77037-1938-4f84-ad69-6927d8bac24f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:19.909537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:19.910524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.910804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.911093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] PATH_INFO: `/v3/projects/e1efd598be0040348685dfe4ffa3e551/users/8ee2d382e6a94533847b4ad62ec15131/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.913079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1efd598be0040348685dfe4ffa3e551, user_id=8ee2d382e6a94533847b4ad62ec15131, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:19.915931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:19.926657 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1352/2708] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:11:19 2022] PUT /identity/v3/projects/e1efd598be0040348685dfe4ffa3e551/users/8ee2d382e6a94533847b4ad62ec15131/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:19.937080 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9ed8-3dc6-4f2c-ae09-4c8e3267591a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:19.937728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9ed8-3dc6-4f2c-ae09-4c8e3267591a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:19.937728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9ed8-3dc6-4f2c-ae09-4c8e3267591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:19.964478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1ede9ed8-3dc6-4f2c-ae09-4c8e3267591a None None] MFA Rules not processed for user `8ee2d382e6a94533847b4ad62ec15131`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:19.965800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1ede9ed8-3dc6-4f2c-ae09-4c8e3267591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:20.005508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:20.057460 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1357/2709] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:11:20.069607 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:20.071349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:20.133455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f3be9-a85c-4f3d-9039-2194a7d7672b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:20.137089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5720f7-4a3c-4350-bb06-c81d98848de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:20.137782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5720f7-4a3c-4350-bb06-c81d98848de5 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:20.138075 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5720f7-4a3c-4350-bb06-c81d98848de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:20.138367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5720f7-4a3c-4350-bb06-c81d98848de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:20.197724 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5720f7-4a3c-4350-bb06-c81d98848de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:20.199192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5720f7-4a3c-4350-bb06-c81d98848de5 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:20.209522 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1353/2710] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:11:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:11:20.604619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9ed8-3dc6-4f2c-ae09-4c8e3267591a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:20.606172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1ede9ed8-3dc6-4f2c-ae09-4c8e3267591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:20.674929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9ed8-3dc6-4f2c-ae09-4c8e3267591a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:20.679637 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:20.680515 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:20.680812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:20.681097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] PATH_INFO: `/v3/users/adb01ba57e244fbabb89b97f61b64050` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:20.682324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb01ba57e244fbabb89b97f61b64050)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:20.684314 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:20.732186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb01ba57e244fbabb89b97f61b64050'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:20.732850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb01ba57e244fbabb89b97f61b64050'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:20.739830 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb01ba57e244fbabb89b97f61b64050'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:20.747244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb01ba57e244fbabb89b97f61b64050'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:20.748103 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2cc6f181-af21-471e-bcb6-17b5399d7b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb01ba57e244fbabb89b97f61b64050'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:20.765943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1358/2711] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:11:20 2022] DELETE /identity/v3/users/adb01ba57e244fbabb89b97f61b64050 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:20.936392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5720f7-4a3c-4350-bb06-c81d98848de5 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:20.948383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5720f7-4a3c-4350-bb06-c81d98848de5 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:21.006746 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:21.007618 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.007906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.008479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] PATH_INFO: `/v3/projects/69e36e2fc5004ae0bbec1acade512c2a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.009387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e36e2fc5004ae0bbec1acade512c2a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:21.011338 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:21.024039 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:21.060925 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e36e2fc5004ae0bbec1acade512c2a', 'request_id': 'req-104cdeec-5821-40fd-af0f-603e0505c39f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:21.070339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e36e2fc5004ae0bbec1acade512c2a', 'request_id': 'req-104cdeec-5821-40fd-af0f-603e0505c39f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:21.076536 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e36e2fc5004ae0bbec1acade512c2a', 'request_id': 'req-104cdeec-5821-40fd-af0f-603e0505c39f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:21.088436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] The token cache is being invalidate because project 69e36e2fc5004ae0bbec1acade512c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:11:21.088734 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:21.089396 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-104cdeec-5821-40fd-af0f-603e0505c39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:21.091005 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1354/2712] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:11:20 2022] DELETE /identity/v3/projects/69e36e2fc5004ae0bbec1acade512c2a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:21.098074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71b6f2-f2d2-45e1-b845-a5aec78f48fe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.098371 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71b6f2-f2d2-45e1-b845-a5aec78f48fe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.098664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71b6f2-f2d2-45e1-b845-a5aec78f48fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.116928 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8c71b6f2-f2d2-45e1-b845-a5aec78f48fe None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:21.120915 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8c71b6f2-f2d2-45e1-b845-a5aec78f48fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:21.169399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:21.189627 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1359/2713] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:21.255579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6be56-4107-4c1d-9282-462e216d3f89 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.255934 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6be56-4107-4c1d-9282-462e216d3f89 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.256251 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6be56-4107-4c1d-9282-462e216d3f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.275224 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-14b6be56-4107-4c1d-9282-462e216d3f89 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:21.276449 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-14b6be56-4107-4c1d-9282-462e216d3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:21.284462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1355/2714] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:21.288638 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71b6f2-f2d2-45e1-b845-a5aec78f48fe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:21.298246 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71b6f2-f2d2-45e1-b845-a5aec78f48fe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:21.303116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:21.303772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.304063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.304348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.305085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:11:21.305399 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:21.307045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:21.318956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1360/2715] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:11:21.323178 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6be56-4107-4c1d-9282-462e216d3f89 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:21.333150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6be56-4107-4c1d-9282-462e216d3f89 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:21.338010 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b583-2f9e-4390-8b30-bb6491d3b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:21.338667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b583-2f9e-4390-8b30-bb6491d3b935 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.338957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b583-2f9e-4390-8b30-bb6491d3b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.339241 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b583-2f9e-4390-8b30-bb6491d3b935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.339943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b583-2f9e-4390-8b30-bb6491d3b935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:21.341889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b583-2f9e-4390-8b30-bb6491d3b935 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:21.366915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1356/2716] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:11:21 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:11:21.371287 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:21.381936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18786b16-4dad-45c3-9731-e0f87744a52b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:21.438871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679329c7-e6d0-4dc7-ab11-4b309168009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:21.439605 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679329c7-e6d0-4dc7-ab11-4b309168009b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.439923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679329c7-e6d0-4dc7-ab11-4b309168009b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.440151 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679329c7-e6d0-4dc7-ab11-4b309168009b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.440841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679329c7-e6d0-4dc7-ab11-4b309168009b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:21.443519 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679329c7-e6d0-4dc7-ab11-4b309168009b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:21.463588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1361/2717] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:11:21 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:11:21.467811 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b583-2f9e-4390-8b30-bb6491d3b935 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:21.478280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b583-2f9e-4390-8b30-bb6491d3b935 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:21.482973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa904a32-f3a0-4402-8627-c3dc826c0c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:21.483642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa904a32-f3a0-4402-8627-c3dc826c0c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.483933 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa904a32-f3a0-4402-8627-c3dc826c0c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.484217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa904a32-f3a0-4402-8627-c3dc826c0c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.484950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa904a32-f3a0-4402-8627-c3dc826c0c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:21.486592 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa904a32-f3a0-4402-8627-c3dc826c0c62 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:21.497368 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1357/2718] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:21.501312 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679329c7-e6d0-4dc7-ab11-4b309168009b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:21.512549 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679329c7-e6d0-4dc7-ab11-4b309168009b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:21.517228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b966f-36bd-4171-9140-3bdc622e3a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:21.517934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b966f-36bd-4171-9140-3bdc622e3a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.518220 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b966f-36bd-4171-9140-3bdc622e3a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.518499 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b966f-36bd-4171-9140-3bdc622e3a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.519981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b966f-36bd-4171-9140-3bdc622e3a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:21.521591 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b966f-36bd-4171-9140-3bdc622e3a95 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:21.535555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1362/2719] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:21.536825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa904a32-f3a0-4402-8627-c3dc826c0c62 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:21.548478 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa904a32-f3a0-4402-8627-c3dc826c0c62 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:21.554275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:21.555173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.555466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.555750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] PATH_INFO: `/v3/projects/39427a7ef2fe4741a554e55840827d24/users/08df539d7191496090dcb9edb0529524/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.572498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39427a7ef2fe4741a554e55840827d24, user_id=08df539d7191496090dcb9edb0529524, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:21.575362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:21.588987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1358/2720] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:11:21 2022] PUT /identity/v3/projects/39427a7ef2fe4741a554e55840827d24/users/08df539d7191496090dcb9edb0529524/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:11:21.594261 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68c4c-7e50-4f8f-9349-2395a2045e70 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.594555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68c4c-7e50-4f8f-9349-2395a2045e70 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.594837 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68c4c-7e50-4f8f-9349-2395a2045e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.613734 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2aa68c4c-7e50-4f8f-9349-2395a2045e70 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:21.614938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2aa68c4c-7e50-4f8f-9349-2395a2045e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:21.679075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1363/2721] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:21.689177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:21.691544 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:21.762332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d211b29-e232-418f-858c-353ee9fde8d6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:21.766036 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082bace-ca9b-428f-b79d-29fb5305eee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:21.766690 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082bace-ca9b-428f-b79d-29fb5305eee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:21.766985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082bace-ca9b-428f-b79d-29fb5305eee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:21.767270 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082bace-ca9b-428f-b79d-29fb5305eee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:21.777113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082bace-ca9b-428f-b79d-29fb5305eee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:21.778635 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082bace-ca9b-428f-b79d-29fb5305eee2 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:21.788950 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1359/2722] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:11:22.768068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa68c4c-7e50-4f8f-9349-2395a2045e70 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:22.769216 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2aa68c4c-7e50-4f8f-9349-2395a2045e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:22.782270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa68c4c-7e50-4f8f-9349-2395a2045e70 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:22.788200 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:22.789333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:22.789787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:22.790351 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] PATH_INFO: `/v3/users/d03cd4e8e8634635bf6de824481d3783` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:22.791891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d03cd4e8e8634635bf6de824481d3783)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:22.794154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:22.850807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd03cd4e8e8634635bf6de824481d3783'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:22.851587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd03cd4e8e8634635bf6de824481d3783'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:22.856445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:22.859146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd03cd4e8e8634635bf6de824481d3783'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:22.871502 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd03cd4e8e8634635bf6de824481d3783'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:22.872367 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd03cd4e8e8634635bf6de824481d3783'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:22.896880 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1364/2723] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:11:22 2022] DELETE /identity/v3/users/d03cd4e8e8634635bf6de824481d3783 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:22.899100 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a35a62-fa35-4003-a92c-b6e68d01e7bc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:22.899593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a35a62-fa35-4003-a92c-b6e68d01e7bc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:22.899680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a35a62-fa35-4003-a92c-b6e68d01e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:22.920150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-63a35a62-fa35-4003-a92c-b6e68d01e7bc None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:22.921391 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-63a35a62-fa35-4003-a92c-b6e68d01e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:22.966712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:23.004405 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1360/2724] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:11:23.014504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:23.015951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:23.087301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd7bcd-d436-40b9-9430-673db091ef3e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:23.091204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158757-f859-4141-95cd-5ae765ce1d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:23.091890 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158757-f859-4141-95cd-5ae765ce1d85 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:23.092193 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158757-f859-4141-95cd-5ae765ce1d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:23.092615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158757-f859-4141-95cd-5ae765ce1d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:23.106521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158757-f859-4141-95cd-5ae765ce1d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:23.109232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158757-f859-4141-95cd-5ae765ce1d85 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:23.139619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1365/2725] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:11:23.492984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a35a62-fa35-4003-a92c-b6e68d01e7bc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:23.494483 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-63a35a62-fa35-4003-a92c-b6e68d01e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:23.508431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a35a62-fa35-4003-a92c-b6e68d01e7bc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:23.519889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:23.520751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:23.521195 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:23.521685 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] PATH_INFO: `/v3/projects/a12b0c9057194d5d88785e2af29ddf1c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:23.523024 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12b0c9057194d5d88785e2af29ddf1c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:23.524967 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:23.578979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12b0c9057194d5d88785e2af29ddf1c', 'request_id': 'req-db49b9b0-bceb-4e1e-99cb-876f75e55d76'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.589509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12b0c9057194d5d88785e2af29ddf1c', 'request_id': 'req-db49b9b0-bceb-4e1e-99cb-876f75e55d76'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.597823 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12b0c9057194d5d88785e2af29ddf1c', 'request_id': 'req-db49b9b0-bceb-4e1e-99cb-876f75e55d76'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.609768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] The token cache is being invalidate because project a12b0c9057194d5d88785e2af29ddf1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:11:23.610059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.610715 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.613059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1361/2726] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:11:23 2022] DELETE /identity/v3/projects/a12b0c9057194d5d88785e2af29ddf1c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:23.617348 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158757-f859-4141-95cd-5ae765ce1d85 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:23.627794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158757-f859-4141-95cd-5ae765ce1d85 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:23.688065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:23.689299 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:23.689686 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:23.690059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] PATH_INFO: `/v3/users/8ee2d382e6a94533847b4ad62ec15131` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:23.691968 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee2d382e6a94533847b4ad62ec15131)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:23.698018 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:23.760342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee2d382e6a94533847b4ad62ec15131'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.761337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee2d382e6a94533847b4ad62ec15131'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.771428 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee2d382e6a94533847b4ad62ec15131'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.779318 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee2d382e6a94533847b4ad62ec15131'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.779953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-92ac8143-810b-4710-881a-f422d09f3d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee2d382e6a94533847b4ad62ec15131'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:23.788987 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:23.801829 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1366/2727] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:11:23 2022] DELETE /identity/v3/users/8ee2d382e6a94533847b4ad62ec15131 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:24.125672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:24.132480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:24.151868 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49b9b0-bceb-4e1e-99cb-876f75e55d76 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:24.230880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:24.231902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.232298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.232687 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] PATH_INFO: `/v3/projects/e1efd598be0040348685dfe4ffa3e551` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.234056 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1efd598be0040348685dfe4ffa3e551)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:24.236358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:24.298850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1efd598be0040348685dfe4ffa3e551', 'request_id': 'req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:24.308263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1efd598be0040348685dfe4ffa3e551', 'request_id': 'req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:24.316355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1efd598be0040348685dfe4ffa3e551', 'request_id': 'req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:24.317980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:24.331298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] The token cache is being invalidate because project e1efd598be0040348685dfe4ffa3e551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:11:24.331866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:24.333221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9aafdd17-31b6-46f9-bfc1-230c5a4c2804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:11:24.335878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1362/2728] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:11:24 2022] DELETE /identity/v3/projects/e1efd598be0040348685dfe4ffa3e551 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:24.340892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921dae0-a53c-4a1a-9906-af02cb675dce None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.341354 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921dae0-a53c-4a1a-9906-af02cb675dce None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.341891 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921dae0-a53c-4a1a-9906-af02cb675dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.366159 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4921dae0-a53c-4a1a-9906-af02cb675dce None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:24.367654 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4921dae0-a53c-4a1a-9906-af02cb675dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:24.454378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1367/2729] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:24.522239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f41c-1b06-4741-91e8-de2d23960a4d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.522586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f41c-1b06-4741-91e8-de2d23960a4d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.522819 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f41c-1b06-4741-91e8-de2d23960a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.544145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-df55f41c-1b06-4741-91e8-de2d23960a4d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:24.545424 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-df55f41c-1b06-4741-91e8-de2d23960a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:24.558702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921dae0-a53c-4a1a-9906-af02cb675dce None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:24.564923 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1363/2730] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:24.572005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921dae0-a53c-4a1a-9906-af02cb675dce None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:24.577441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:24.578904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.579295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.579698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.580550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:11:24.580964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:24.583523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:24.608814 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1368/2731] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:11:24.613238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55f41c-1b06-4741-91e8-de2d23960a4d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:24.624090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55f41c-1b06-4741-91e8-de2d23960a4d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:24.630532 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475b1c7-cead-4f18-8e1c-9336892d0bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:24.631326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b1c7-cead-4f18-8e1c-9336892d0bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.631717 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b1c7-cead-4f18-8e1c-9336892d0bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.632132 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b1c7-cead-4f18-8e1c-9336892d0bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.632968 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475b1c7-cead-4f18-8e1c-9336892d0bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:24.635119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475b1c7-cead-4f18-8e1c-9336892d0bbd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:24.674850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1364/2732] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:11:24 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:11:24.679864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:24.701337 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8424f3-7194-44a7-98be-c691d9e5b0d8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:24.775105 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3626f-436c-47d0-9b5c-a5e3d610ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:24.775737 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3626f-436c-47d0-9b5c-a5e3d610ac47 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.775956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3626f-436c-47d0-9b5c-a5e3d610ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.776305 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3626f-436c-47d0-9b5c-a5e3d610ac47 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.777116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3626f-436c-47d0-9b5c-a5e3d610ac47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:24.779345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3626f-436c-47d0-9b5c-a5e3d610ac47 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:24.807550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1369/2733] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:11:24 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:11:24.808666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475b1c7-cead-4f18-8e1c-9336892d0bbd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:24.823251 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475b1c7-cead-4f18-8e1c-9336892d0bbd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:24.829574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd1684-af83-4a2f-a0e6-91edd9c3e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:24.830259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1684-af83-4a2f-a0e6-91edd9c3e7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.830554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1684-af83-4a2f-a0e6-91edd9c3e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.830842 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1684-af83-4a2f-a0e6-91edd9c3e7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.832443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd1684-af83-4a2f-a0e6-91edd9c3e7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:24.834226 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd1684-af83-4a2f-a0e6-91edd9c3e7f4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:24.845881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1365/2734] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:11:24.850985 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3626f-436c-47d0-9b5c-a5e3d610ac47 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:24.864855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3626f-436c-47d0-9b5c-a5e3d610ac47 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:24.871834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84ea7d-753a-494a-a304-ae260f9969a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:24.872539 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ea7d-753a-494a-a304-ae260f9969a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.872834 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ea7d-753a-494a-a304-ae260f9969a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.873115 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ea7d-753a-494a-a304-ae260f9969a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.874113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84ea7d-753a-494a-a304-ae260f9969a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:24.876053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84ea7d-753a-494a-a304-ae260f9969a8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:24.889257 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1370/2735] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:24.894643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd1684-af83-4a2f-a0e6-91edd9c3e7f4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:24.911940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd1684-af83-4a2f-a0e6-91edd9c3e7f4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:24.919293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:24.920293 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.921199 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.921574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] PATH_INFO: `/v3/projects/506089059e204d749be93ce40bb6a61b/users/828785dddd304d29b0ecf97304fb3468/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:24.948665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506089059e204d749be93ce40bb6a61b, user_id=828785dddd304d29b0ecf97304fb3468, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:24.952421 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:24.978965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1366/2736] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:11:24 2022] PUT /identity/v3/projects/506089059e204d749be93ce40bb6a61b/users/828785dddd304d29b0ecf97304fb3468/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:24.989524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b03082-6bc2-4699-8ac2-c1ef8d406976 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:24.990102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b03082-6bc2-4699-8ac2-c1ef8d406976 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:24.990550 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b03082-6bc2-4699-8ac2-c1ef8d406976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:25.030285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d3b03082-6bc2-4699-8ac2-c1ef8d406976 None None] MFA Rules not processed for user `828785dddd304d29b0ecf97304fb3468`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:25.031833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d3b03082-6bc2-4699-8ac2-c1ef8d406976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:25.101478 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:25.133904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1371/2737] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:25.143463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:25.146616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:25.241518 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d33d4-0e93-44de-8d86-f88c15c69f99 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:25.245917 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:25.247023 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:25.247455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:25.247886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:25.263248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:25.264732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:25.286438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1367/2738] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:11:26.090000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59edab-3aa5-4bbf-903a-02919741723a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:26.090496 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59edab-3aa5-4bbf-903a-02919741723a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:26.090621 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59edab-3aa5-4bbf-903a-02919741723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:26.121095 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7d59edab-3aa5-4bbf-903a-02919741723a None None] MFA Rules not processed for user `08df539d7191496090dcb9edb0529524`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:26.122349 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d59edab-3aa5-4bbf-903a-02919741723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:26.190289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1372/2739] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:26.195101 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:26.196547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:26.273796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00d3ee-5122-4192-aeca-344bd4ec7486 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:26.278500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d6da1-50c7-499c-96ac-75d856872a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:26.279284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d6da1-50c7-499c-96ac-75d856872a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:26.279575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d6da1-50c7-499c-96ac-75d856872a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:26.279859 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d6da1-50c7-499c-96ac-75d856872a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:26.280605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d6da1-50c7-499c-96ac-75d856872a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:26.282574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d6da1-50c7-499c-96ac-75d856872a3a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:26.313150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1368/2740] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:11:26 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:11:26.314538 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59edab-3aa5-4bbf-903a-02919741723a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:26.326176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59edab-3aa5-4bbf-903a-02919741723a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:26.389412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0be5e7-28bf-4728-93b1-7c65e9a06470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:26.398781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0be5e7-28bf-4728-93b1-7c65e9a06470 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:26.398781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0be5e7-28bf-4728-93b1-7c65e9a06470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:26.398781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0be5e7-28bf-4728-93b1-7c65e9a06470 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:26.398781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0be5e7-28bf-4728-93b1-7c65e9a06470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:26.398781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0be5e7-28bf-4728-93b1-7c65e9a06470 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:26.434920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1373/2741] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:11:26 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:11:26.439008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d6da1-50c7-499c-96ac-75d856872a3a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:26.452263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d6da1-50c7-499c-96ac-75d856872a3a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:26.458666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af88712-3f85-42e2-b432-85a5dc5593f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:26.459361 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af88712-3f85-42e2-b432-85a5dc5593f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:26.459653 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af88712-3f85-42e2-b432-85a5dc5593f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:26.459937 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af88712-3f85-42e2-b432-85a5dc5593f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:26.460684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af88712-3f85-42e2-b432-85a5dc5593f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:26.462354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af88712-3f85-42e2-b432-85a5dc5593f0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:26.474474 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1369/2742] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:26.478780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0be5e7-28bf-4728-93b1-7c65e9a06470 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:26.489874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0be5e7-28bf-4728-93b1-7c65e9a06470 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:26.495064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcab6b-cb91-4094-a553-61097fcbdaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:26.496368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcab6b-cb91-4094-a553-61097fcbdaca admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:26.496661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcab6b-cb91-4094-a553-61097fcbdaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:26.496945 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcab6b-cb91-4094-a553-61097fcbdaca admin admin] PATH_INFO: `/v3/projects/15d658232ffd40429965f3db9ab2c826/users/02753b84118f4857988c8ebfe450ceb6/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:26.513936 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcab6b-cb91-4094-a553-61097fcbdaca admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d658232ffd40429965f3db9ab2c826, user_id=02753b84118f4857988c8ebfe450ceb6, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:26.516638 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcab6b-cb91-4094-a553-61097fcbdaca admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:26.533019 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1374/2743] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:11:26 2022] PUT /identity/v3/projects/15d658232ffd40429965f3db9ab2c826/users/02753b84118f4857988c8ebfe450ceb6/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:26.537560 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af88712-3f85-42e2-b432-85a5dc5593f0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:26.548395 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af88712-3f85-42e2-b432-85a5dc5593f0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:26.552680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:26.610884 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65343fb2-bb4d-4936-a600-61ddb4c8291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:26.611577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65343fb2-bb4d-4936-a600-61ddb4c8291c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:26.611873 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65343fb2-bb4d-4936-a600-61ddb4c8291c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:26.612162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65343fb2-bb4d-4936-a600-61ddb4c8291c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:26.613683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65343fb2-bb4d-4936-a600-61ddb4c8291c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:26.615326 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65343fb2-bb4d-4936-a600-61ddb4c8291c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:26.626205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1370/2744] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:11:26.630623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcab6b-cb91-4094-a553-61097fcbdaca admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:26.641230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcab6b-cb91-4094-a553-61097fcbdaca admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:26.647400 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:26.648324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:26.648626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:26.648900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] PATH_INFO: `/v3/projects/15d658232ffd40429965f3db9ab2c826/users/02753b84118f4857988c8ebfe450ceb6/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:26.651081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d658232ffd40429965f3db9ab2c826, user_id=02753b84118f4857988c8ebfe450ceb6, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:26.653874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:26.666188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1375/2745] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:11:26 2022] PUT /identity/v3/projects/15d658232ffd40429965f3db9ab2c826/users/02753b84118f4857988c8ebfe450ceb6/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:11:31.338682 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a08aef-5463-46aa-8bae-aa10aba2c189 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:31.339229 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a08aef-5463-46aa-8bae-aa10aba2c189 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:31.339329 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a08aef-5463-46aa-8bae-aa10aba2c189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:31.372584 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-88a08aef-5463-46aa-8bae-aa10aba2c189 None None] MFA Rules not processed for user `02753b84118f4857988c8ebfe450ceb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:31.373896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-88a08aef-5463-46aa-8bae-aa10aba2c189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:31.458640 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1371/2746] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:31.475369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:11:31.476888 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:31.516754 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:31.562524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727be1-079a-46e9-b769-91127864b62f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:11:31.569369 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895d03-5945-4e06-aac5-43e7be60a27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:11:31.570078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895d03-5945-4e06-aac5-43e7be60a27a service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:31.570370 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895d03-5945-4e06-aac5-43e7be60a27a service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:31.570674 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895d03-5945-4e06-aac5-43e7be60a27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:31.630196 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895d03-5945-4e06-aac5-43e7be60a27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:11:31.631826 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895d03-5945-4e06-aac5-43e7be60a27a service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:11:31.642623 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1376/2747] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:11:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:11:32.880120 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00185f4-6ac7-46ee-8845-5bcb60fa1b06 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:11:32.880675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00185f4-6ac7-46ee-8845-5bcb60fa1b06 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:11:32.880785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00185f4-6ac7-46ee-8845-5bcb60fa1b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:11:32.901572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b00185f4-6ac7-46ee-8845-5bcb60fa1b06 None None] MFA Rules not processed for user `08df539d7191496090dcb9edb0529524`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:11:32.902821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b00185f4-6ac7-46ee-8845-5bcb60fa1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:11:32.910318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1372/2748] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:11:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:11:41.637806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=43 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:11:42.895611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=63 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:00.431949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895d03-5945-4e06-aac5-43e7be60a27a service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:00.521685 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895d03-5945-4e06-aac5-43e7be60a27a service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:00.526402 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:00.527256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:00.527542 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:00.527824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] PATH_INFO: `/v3/users/828785dddd304d29b0ecf97304fb3468` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:00.529026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828785dddd304d29b0ecf97304fb3468)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:00.530972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:00.578142 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828785dddd304d29b0ecf97304fb3468'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.578803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828785dddd304d29b0ecf97304fb3468'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.586421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828785dddd304d29b0ecf97304fb3468'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.596813 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828785dddd304d29b0ecf97304fb3468'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.597743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828785dddd304d29b0ecf97304fb3468'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.616301 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1377/2749] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:12:00 2022] DELETE /identity/v3/users/828785dddd304d29b0ecf97304fb3468 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:00.621068 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9a2df-99c6-4876-afb6-d4b2b0c02e2e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:00.621526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9a2df-99c6-4876-afb6-d4b2b0c02e2e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:00.621931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9a2df-99c6-4876-afb6-d4b2b0c02e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:00.674625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dec9a2df-99c6-4876-afb6-d4b2b0c02e2e None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:00.676696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dec9a2df-99c6-4876-afb6-d4b2b0c02e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:00.746455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:00.748072 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:00.761767 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1373/2750] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:00.764327 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c520c5-df1d-4101-83d1-1eba4b608924 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:00.769658 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:00.770464 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9a2df-99c6-4876-afb6-d4b2b0c02e2e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:00.770699 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:00.771651 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:00.772027 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] PATH_INFO: `/v3/users/935a5730c5714709b13e8651b704a96c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:00.773292 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dec9a2df-99c6-4876-afb6-d4b2b0c02e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:00.773412 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935a5730c5714709b13e8651b704a96c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:00.775405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:00.824170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935a5730c5714709b13e8651b704a96c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.824856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935a5730c5714709b13e8651b704a96c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.826971 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:00.836041 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935a5730c5714709b13e8651b704a96c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.843902 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935a5730c5714709b13e8651b704a96c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.844628 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-94b60d11-2583-4c5d-906b-ab80f1862e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935a5730c5714709b13e8651b704a96c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:00.852524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9a2df-99c6-4876-afb6-d4b2b0c02e2e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:00.856301 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:00.856958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:00.857253 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:00.857537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:00.859443 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:00.864339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1378/2751] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:12:00 2022] DELETE /identity/v3/users/935a5730c5714709b13e8651b704a96c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:12:00.870356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be008-b7b8-428b-ba04-3a1462f990ab None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:00.872026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be008-b7b8-428b-ba04-3a1462f990ab None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:00.872492 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be008-b7b8-428b-ba04-3a1462f990ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:00.873751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:00.875271 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:00.886557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1374/2752] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:12:00.893745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-636be008-b7b8-428b-ba04-3a1462f990ab None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:00.894966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-636be008-b7b8-428b-ba04-3a1462f990ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:00.959764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1379/2753] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:12:00.970864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:00.971829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:00.983463 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414dd41-2d9d-4b8b-99ff-38affe5bca85 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.037701 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f5b4c-9e76-421e-9742-f0c032a73322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.038383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f5b4c-9e76-421e-9742-f0c032a73322 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.038673 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f5b4c-9e76-421e-9742-f0c032a73322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.038961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f5b4c-9e76-421e-9742-f0c032a73322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.048492 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f5b4c-9e76-421e-9742-f0c032a73322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.049989 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f5b4c-9e76-421e-9742-f0c032a73322 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.060591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1375/2754] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:01.187970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be008-b7b8-428b-ba04-3a1462f990ab None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.189653 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-636be008-b7b8-428b-ba04-3a1462f990ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:01.215156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be008-b7b8-428b-ba04-3a1462f990ab None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.223601 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.225060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.225408 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.225785 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] PATH_INFO: `/v3/projects/506089059e204d749be93ce40bb6a61b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.227903 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506089059e204d749be93ce40bb6a61b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.230176 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.280573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506089059e204d749be93ce40bb6a61b', 'request_id': 'req-7174a55e-1128-4f9b-83a6-56a2220fb7d7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.287835 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506089059e204d749be93ce40bb6a61b', 'request_id': 'req-7174a55e-1128-4f9b-83a6-56a2220fb7d7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.295733 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506089059e204d749be93ce40bb6a61b', 'request_id': 'req-7174a55e-1128-4f9b-83a6-56a2220fb7d7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.308251 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] The token cache is being invalidate because project 506089059e204d749be93ce40bb6a61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:12:01.308546 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.309227 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.310817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1380/2755] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:12:01 2022] DELETE /identity/v3/projects/506089059e204d749be93ce40bb6a61b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:01.315644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9340e3-04ed-41cc-a36d-ac3192b77107 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.315945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9340e3-04ed-41cc-a36d-ac3192b77107 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.316231 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9340e3-04ed-41cc-a36d-ac3192b77107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.323013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:01.344507 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.345942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:01.346378 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ac9340e3-04ed-41cc-a36d-ac3192b77107 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:01.347712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ac9340e3-04ed-41cc-a36d-ac3192b77107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:01.421352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:01.423376 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1376/2756] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:01.435498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599da0-f02b-4a85-8471-45078282d8c5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.435498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599da0-f02b-4a85-8471-45078282d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.435498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599da0-f02b-4a85-8471-45078282d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.439107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174a55e-1128-4f9b-83a6-56a2220fb7d7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.444894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.445817 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.446110 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.446395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] PATH_INFO: `/v3/projects/1fd67e8030b84fa2b5e00d66b5d5ddfa` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.447604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd67e8030b84fa2b5e00d66b5d5ddfa)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.449534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.453672 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1b599da0-f02b-4a85-8471-45078282d8c5 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:01.454887 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1b599da0-f02b-4a85-8471-45078282d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:01.463351 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1377/2757] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:01.467383 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599da0-f02b-4a85-8471-45078282d8c5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.477093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599da0-f02b-4a85-8471-45078282d8c5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.482144 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.482857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.483147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.483442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.484173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:12:01.484480 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.486126 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.498543 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd67e8030b84fa2b5e00d66b5d5ddfa', 'request_id': 'req-a42f038b-bbaf-4ad1-b561-7d012622e1b3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.502214 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1378/2758] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:12:01.503258 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.505177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd67e8030b84fa2b5e00d66b5d5ddfa', 'request_id': 'req-a42f038b-bbaf-4ad1-b561-7d012622e1b3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.513001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd67e8030b84fa2b5e00d66b5d5ddfa', 'request_id': 'req-a42f038b-bbaf-4ad1-b561-7d012622e1b3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.513217 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8f37f-98ce-4d4d-84d4-604260cbda5f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.524055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] The token cache is being invalidate because project 1fd67e8030b84fa2b5e00d66b5d5ddfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:12:01.524345 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.525004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.526614 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1381/2759] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:12:01 2022] DELETE /identity/v3/projects/1fd67e8030b84fa2b5e00d66b5d5ddfa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:12:01.530438 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.531779 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:01.571310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.571310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.571658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.571658 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.573410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.575798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.603077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f038b-bbaf-4ad1-b561-7d012622e1b3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.608312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1379/2760] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:12:01 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:01.609369 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.611325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:01.663677 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.664513 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.664803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.665085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] PATH_INFO: `/v3/users/8740c8c30ecf43af9cd02a64b4898191` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.666554 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8740c8c30ecf43af9cd02a64b4898191)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.668524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.686204 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ba54-7c26-480a-9d19-733af7366459 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.696671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b09e9f-bf3d-4a14-b297-34f6fb2ecd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.697461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b09e9f-bf3d-4a14-b297-34f6fb2ecd0c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.697786 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b09e9f-bf3d-4a14-b297-34f6fb2ecd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.698076 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b09e9f-bf3d-4a14-b297-34f6fb2ecd0c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.698785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b09e9f-bf3d-4a14-b297-34f6fb2ecd0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.700795 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b09e9f-bf3d-4a14-b297-34f6fb2ecd0c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.707620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:01.712545 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:01.735329 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8740c8c30ecf43af9cd02a64b4898191'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.736281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8740c8c30ecf43af9cd02a64b4898191'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.736846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1380/2761] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:12:01 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:01.742901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b09e9f-bf3d-4a14-b297-34f6fb2ecd0c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.747108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8740c8c30ecf43af9cd02a64b4898191'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.754019 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b09e9f-bf3d-4a14-b297-34f6fb2ecd0c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.756976 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8740c8c30ecf43af9cd02a64b4898191'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.758244 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8740c8c30ecf43af9cd02a64b4898191'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:01.759566 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.760412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.760696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.760977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.762104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.763736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.777586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1381/2762] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:01.779826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.781641 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:01.789964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1382/2763] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:12:01 2022] DELETE /identity/v3/users/8740c8c30ecf43af9cd02a64b4898191 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:01.796001 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49881dd-754a-4c2b-8932-a07aa05b79e2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.854931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726f85a-81b6-4a22-9c41-1780be7c4e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.855616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726f85a-81b6-4a22-9c41-1780be7c4e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.855913 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726f85a-81b6-4a22-9c41-1780be7c4e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.856193 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726f85a-81b6-4a22-9c41-1780be7c4e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.856939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726f85a-81b6-4a22-9c41-1780be7c4e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.858564 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726f85a-81b6-4a22-9c41-1780be7c4e1c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.869009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1382/2764] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:12:01.873407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:01.884089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c096a-106b-42d3-b9bd-4eec4e8942fe admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:01.889067 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:01.890001 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.890316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.890596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] PATH_INFO: `/v3/projects/700431091a924981bc2615de6497319d/users/738bbccf2dbd4f38b02c981d11d45834/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.907894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700431091a924981bc2615de6497319d, user_id=738bbccf2dbd4f38b02c981d11d45834, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:01.910609 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:01.926152 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1383/2765] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:01 2022] PUT /identity/v3/projects/700431091a924981bc2615de6497319d/users/738bbccf2dbd4f38b02c981d11d45834/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:01.931485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade67c3-5b8e-4e6c-96a0-8c752692731f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:01.931862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade67c3-5b8e-4e6c-96a0-8c752692731f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:01.933002 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade67c3-5b8e-4e6c-96a0-8c752692731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:01.954732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7ade67c3-5b8e-4e6c-96a0-8c752692731f None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:01.955969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7ade67c3-5b8e-4e6c-96a0-8c752692731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:02.018768 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1383/2766] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:12:02.028972 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.030808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:02.076882 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade67c3-5b8e-4e6c-96a0-8c752692731f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.078741 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7ade67c3-5b8e-4e6c-96a0-8c752692731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:02.093310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade67c3-5b8e-4e6c-96a0-8c752692731f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.105915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.106915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.107333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.107572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] PATH_INFO: `/v3/projects/3eef37e4349145bea9d4f5cb7e756fba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.109850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eef37e4349145bea9d4f5cb7e756fba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.111871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.113497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801282-8245-4590-9c36-b7197bb6e315 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.124111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a595fd-7f98-43ba-a41f-9e54f3f6690d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.124857 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a595fd-7f98-43ba-a41f-9e54f3f6690d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.125282 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a595fd-7f98-43ba-a41f-9e54f3f6690d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.125704 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a595fd-7f98-43ba-a41f-9e54f3f6690d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.136488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a595fd-7f98-43ba-a41f-9e54f3f6690d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.138218 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a595fd-7f98-43ba-a41f-9e54f3f6690d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.149283 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1384/2767] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:02.163528 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eef37e4349145bea9d4f5cb7e756fba', 'request_id': 'req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:02.172457 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eef37e4349145bea9d4f5cb7e756fba', 'request_id': 'req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:02.179541 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eef37e4349145bea9d4f5cb7e756fba', 'request_id': 'req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:02.191674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] The token cache is being invalidate because project 3eef37e4349145bea9d4f5cb7e756fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:12:02.191971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:02.192705 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb56bb51-d52b-43a1-a7c9-b6def655fa0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:02.194427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1384/2768] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:12:02 2022] DELETE /identity/v3/projects/3eef37e4349145bea9d4f5cb7e756fba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:12:02.199288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acea1-978d-4679-82b6-e5e10fe3d9c2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.199579 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acea1-978d-4679-82b6-e5e10fe3d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.199861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acea1-978d-4679-82b6-e5e10fe3d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.218607 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-597acea1-978d-4679-82b6-e5e10fe3d9c2 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:02.219820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-597acea1-978d-4679-82b6-e5e10fe3d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:02.283722 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1385/2769] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:02.293333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee644a3-07a3-4ae1-9585-671d8025e95d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.293782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee644a3-07a3-4ae1-9585-671d8025e95d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.294176 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee644a3-07a3-4ae1-9585-671d8025e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.301255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:02.316718 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7ee644a3-07a3-4ae1-9585-671d8025e95d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:02.318548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7ee644a3-07a3-4ae1-9585-671d8025e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:02.327145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1385/2770] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:02.332035 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acea1-978d-4679-82b6-e5e10fe3d9c2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.345913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acea1-978d-4679-82b6-e5e10fe3d9c2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.350863 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.351534 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.351823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.352107 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.352850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:12:02.353160 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.354847 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.367284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1386/2771] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:12:02.372812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee644a3-07a3-4ae1-9585-671d8025e95d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.384516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee644a3-07a3-4ae1-9585-671d8025e95d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.389379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66423-114d-478c-901a-1ad5b01e2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.390098 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66423-114d-478c-901a-1ad5b01e2224 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.395549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66423-114d-478c-901a-1ad5b01e2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.395880 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66423-114d-478c-901a-1ad5b01e2224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.396669 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66423-114d-478c-901a-1ad5b01e2224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.398805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66423-114d-478c-901a-1ad5b01e2224 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.436837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1386/2772] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:12:02 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:02.440883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.451761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856c7e7-12e1-4d25-9bb9-3db026a31498 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.461241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:02.526615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770aec2-8888-47cb-a929-de877985cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.527307 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770aec2-8888-47cb-a929-de877985cba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.527593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770aec2-8888-47cb-a929-de877985cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.527872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770aec2-8888-47cb-a929-de877985cba2 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.528568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770aec2-8888-47cb-a929-de877985cba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.530548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770aec2-8888-47cb-a929-de877985cba2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.553634 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1387/2773] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:12:02 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:12:02.557732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66423-114d-478c-901a-1ad5b01e2224 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.571054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66423-114d-478c-901a-1ad5b01e2224 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.576055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73bc78-fad2-4345-974d-fc2b23b154aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.576738 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73bc78-fad2-4345-974d-fc2b23b154aa admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.577035 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73bc78-fad2-4345-974d-fc2b23b154aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.577310 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73bc78-fad2-4345-974d-fc2b23b154aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.578169 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73bc78-fad2-4345-974d-fc2b23b154aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.579877 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73bc78-fad2-4345-974d-fc2b23b154aa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.592339 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1387/2774] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:12:02.596270 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770aec2-8888-47cb-a929-de877985cba2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.606633 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770aec2-8888-47cb-a929-de877985cba2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.611471 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c151d9-70ee-4b69-b70e-7d78f7366286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.612207 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c151d9-70ee-4b69-b70e-7d78f7366286 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.612561 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c151d9-70ee-4b69-b70e-7d78f7366286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.612927 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c151d9-70ee-4b69-b70e-7d78f7366286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.613743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c151d9-70ee-4b69-b70e-7d78f7366286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.615911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c151d9-70ee-4b69-b70e-7d78f7366286 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.626741 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1388/2775] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:02.630953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73bc78-fad2-4345-974d-fc2b23b154aa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.641280 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73bc78-fad2-4345-974d-fc2b23b154aa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.647370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080d806-50e5-45db-9cfb-d960b901c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.648371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d806-50e5-45db-9cfb-d960b901c965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.648752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d806-50e5-45db-9cfb-d960b901c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.649089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d806-50e5-45db-9cfb-d960b901c965 admin admin] PATH_INFO: `/v3/projects/3aa78a15a58d41dc8868337c7549a598/users/89b685b285e9451f92cbde272fca1122/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.665119 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080d806-50e5-45db-9cfb-d960b901c965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa78a15a58d41dc8868337c7549a598, user_id=89b685b285e9451f92cbde272fca1122, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.667944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080d806-50e5-45db-9cfb-d960b901c965 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.681982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1388/2776] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:02 2022] PUT /identity/v3/projects/3aa78a15a58d41dc8868337c7549a598/users/89b685b285e9451f92cbde272fca1122/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:12:02.692368 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6434-53a1-4eaa-90a0-c7cdac71df46 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.692712 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6434-53a1-4eaa-90a0-c7cdac71df46 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.693020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6434-53a1-4eaa-90a0-c7cdac71df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.721536 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c02c6434-53a1-4eaa-90a0-c7cdac71df46 None None] MFA Rules not processed for user `89b685b285e9451f92cbde272fca1122`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:02.722728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c02c6434-53a1-4eaa-90a0-c7cdac71df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:02.797631 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1389/2777] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:02.802844 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080d806-50e5-45db-9cfb-d960b901c965 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.892079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080d806-50e5-45db-9cfb-d960b901c965 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:02.898327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6293cc-cf3f-4d05-8d0a-ed8db9e6504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:02.899548 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6293cc-cf3f-4d05-8d0a-ed8db9e6504e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:02.900173 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6293cc-cf3f-4d05-8d0a-ed8db9e6504e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:02.900456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6293cc-cf3f-4d05-8d0a-ed8db9e6504e admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:02.901446 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6293cc-cf3f-4d05-8d0a-ed8db9e6504e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:02.903802 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6293cc-cf3f-4d05-8d0a-ed8db9e6504e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:02.935438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1389/2778] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:12:02 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:12:02.939529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c6434-53a1-4eaa-90a0-c7cdac71df46 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:02.953781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c6434-53a1-4eaa-90a0-c7cdac71df46 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:03.021486 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b39896-9b10-4252-98fe-04cbbdef06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:03.022497 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39896-9b10-4252-98fe-04cbbdef06ed admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:03.022883 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39896-9b10-4252-98fe-04cbbdef06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:03.023404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39896-9b10-4252-98fe-04cbbdef06ed admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:03.024204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b39896-9b10-4252-98fe-04cbbdef06ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:03.026284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b39896-9b10-4252-98fe-04cbbdef06ed admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:03.052772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1390/2779] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:12:02 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:12:03.056304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6293cc-cf3f-4d05-8d0a-ed8db9e6504e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:03.067354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6293cc-cf3f-4d05-8d0a-ed8db9e6504e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:03.072479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d701f-d34c-4e8c-9107-78b5f78c8b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:03.073156 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d701f-d34c-4e8c-9107-78b5f78c8b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:03.073442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d701f-d34c-4e8c-9107-78b5f78c8b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:03.073781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d701f-d34c-4e8c-9107-78b5f78c8b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:03.074643 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d701f-d34c-4e8c-9107-78b5f78c8b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:03.076858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d701f-d34c-4e8c-9107-78b5f78c8b66 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:03.087971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1390/2780] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:03.092197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b39896-9b10-4252-98fe-04cbbdef06ed admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:03.103661 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b39896-9b10-4252-98fe-04cbbdef06ed admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:03.124979 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ec778-6eaa-4e9d-8b1d-d89b2bb6a13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:03.125707 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ec778-6eaa-4e9d-8b1d-d89b2bb6a13a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:03.126098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ec778-6eaa-4e9d-8b1d-d89b2bb6a13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:03.126782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ec778-6eaa-4e9d-8b1d-d89b2bb6a13a admin admin] PATH_INFO: `/v3/projects/895a523c4e4f408293425807da18cc8b/users/30e1093baf7248beb215ed75fd25f0f1/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:03.136098 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:03.144503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ec778-6eaa-4e9d-8b1d-d89b2bb6a13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=895a523c4e4f408293425807da18cc8b, user_id=30e1093baf7248beb215ed75fd25f0f1, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:03.148896 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ec778-6eaa-4e9d-8b1d-d89b2bb6a13a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:03.165626 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1391/2781] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:03 2022] PUT /identity/v3/projects/895a523c4e4f408293425807da18cc8b/users/30e1093baf7248beb215ed75fd25f0f1/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:03.168362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d701f-d34c-4e8c-9107-78b5f78c8b66 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:03.179637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d701f-d34c-4e8c-9107-78b5f78c8b66 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:03.243516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d77c7c-fb58-4b09-877f-d4a4acb55f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:03.244157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d77c7c-fb58-4b09-877f-d4a4acb55f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:03.244409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d77c7c-fb58-4b09-877f-d4a4acb55f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:03.244698 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d77c7c-fb58-4b09-877f-d4a4acb55f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:03.245447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d77c7c-fb58-4b09-877f-d4a4acb55f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:03.247387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d77c7c-fb58-4b09-877f-d4a4acb55f82 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:03.259074 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1391/2782] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:03.263490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ec778-6eaa-4e9d-8b1d-d89b2bb6a13a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:03.276774 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ec778-6eaa-4e9d-8b1d-d89b2bb6a13a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:03.281594 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:03.282533 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:03.282827 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:03.283234 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] PATH_INFO: `/v3/projects/895a523c4e4f408293425807da18cc8b/users/30e1093baf7248beb215ed75fd25f0f1/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:03.285897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] RBAC: Authorizing `identity:create_grant(project_id=895a523c4e4f408293425807da18cc8b, user_id=30e1093baf7248beb215ed75fd25f0f1, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:03.288780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:03.308213 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1392/2783] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:03 2022] PUT /identity/v3/projects/895a523c4e4f408293425807da18cc8b/users/30e1093baf7248beb215ed75fd25f0f1/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:03.313018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c744f9-05db-4368-b776-28e4c2e4f677 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:03.313312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c744f9-05db-4368-b776-28e4c2e4f677 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:03.313660 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c744f9-05db-4368-b776-28e4c2e4f677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:03.343504 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:03.358200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-44c744f9-05db-4368-b776-28e4c2e4f677 None None] MFA Rules not processed for user `30e1093baf7248beb215ed75fd25f0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:03.361159 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-44c744f9-05db-4368-b776-28e4c2e4f677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:03.464747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1392/2784] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:03.476881 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:03.479189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:03.563437 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761ca0d-b196-43f2-b343-28e46532936c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:03.569593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbe345-30da-4690-8dbd-90d1af5684cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:03.570781 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbe345-30da-4690-8dbd-90d1af5684cd service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:03.571172 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbe345-30da-4690-8dbd-90d1af5684cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:03.571572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbe345-30da-4690-8dbd-90d1af5684cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:03.583920 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbe345-30da-4690-8dbd-90d1af5684cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:03.589926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbe345-30da-4690-8dbd-90d1af5684cd service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:03.601894 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1393/2785] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:03.682208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c744f9-05db-4368-b776-28e4c2e4f677 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:03.693853 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c744f9-05db-4368-b776-28e4c2e4f677 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:03.697977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:03.698725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:03.699090 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:03.699447 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:03.800825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:03.803192 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:03.813471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1393/2786] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:06.398825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada0dc1-98fb-488b-9e41-fb422428a4f2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:06.399315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada0dc1-98fb-488b-9e41-fb422428a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:06.399315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada0dc1-98fb-488b-9e41-fb422428a4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:06.432225 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bada0dc1-98fb-488b-9e41-fb422428a4f2 None None] MFA Rules not processed for user `738bbccf2dbd4f38b02c981d11d45834`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:06.433524 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bada0dc1-98fb-488b-9e41-fb422428a4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:06.525357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1394/2787] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:06.525750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:06.527408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:06.640007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9544d37-bb84-4c60-a76e-b353947a1975 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:06.644865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7a2b-6fee-4350-872e-ebb1e0236692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:06.645621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7a2b-6fee-4350-872e-ebb1e0236692 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:06.646430 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7a2b-6fee-4350-872e-ebb1e0236692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:06.646837 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7a2b-6fee-4350-872e-ebb1e0236692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:06.647553 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a7a2b-6fee-4350-872e-ebb1e0236692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:06.649605 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a7a2b-6fee-4350-872e-ebb1e0236692 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:06.679030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1394/2788] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:12:06 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:06.683158 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada0dc1-98fb-488b-9e41-fb422428a4f2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:06.702595 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada0dc1-98fb-488b-9e41-fb422428a4f2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:06.775596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f80b48-842d-4330-9d9b-45ab5921d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:06.776346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80b48-842d-4330-9d9b-45ab5921d88c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:06.776636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80b48-842d-4330-9d9b-45ab5921d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:06.776934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80b48-842d-4330-9d9b-45ab5921d88c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:06.777647 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f80b48-842d-4330-9d9b-45ab5921d88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:06.779611 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f80b48-842d-4330-9d9b-45ab5921d88c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:06.791441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:06.805762 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1395/2789] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:12:06 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:06.806829 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7a2b-6fee-4350-872e-ebb1e0236692 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:06.818889 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7a2b-6fee-4350-872e-ebb1e0236692 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:06.823775 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecd47b-0988-49d3-95cf-6e84cdbdbb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:06.824459 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecd47b-0988-49d3-95cf-6e84cdbdbb0f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:06.824747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecd47b-0988-49d3-95cf-6e84cdbdbb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:06.825031 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecd47b-0988-49d3-95cf-6e84cdbdbb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:06.825821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecd47b-0988-49d3-95cf-6e84cdbdbb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:06.827439 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecd47b-0988-49d3-95cf-6e84cdbdbb0f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:06.841007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1395/2790] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:12:06.845108 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f80b48-842d-4330-9d9b-45ab5921d88c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:06.855886 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f80b48-842d-4330-9d9b-45ab5921d88c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:06.860842 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0997777-5846-42d8-82d6-a5b8af7456b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:06.862005 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997777-5846-42d8-82d6-a5b8af7456b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:06.862141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997777-5846-42d8-82d6-a5b8af7456b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:06.862338 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997777-5846-42d8-82d6-a5b8af7456b6 admin admin] PATH_INFO: `/v3/projects/935cd374b4b84b66a72fb204904cd570/users/78744e49097c47fe9556421949e178e9/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:06.881096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0997777-5846-42d8-82d6-a5b8af7456b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935cd374b4b84b66a72fb204904cd570, user_id=78744e49097c47fe9556421949e178e9, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:06.884342 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0997777-5846-42d8-82d6-a5b8af7456b6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:06.899214 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1396/2791] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:06 2022] PUT /identity/v3/projects/935cd374b4b84b66a72fb204904cd570/users/78744e49097c47fe9556421949e178e9/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:06.903200 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecd47b-0988-49d3-95cf-6e84cdbdbb0f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:06.913726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecd47b-0988-49d3-95cf-6e84cdbdbb0f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:06.918493 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:06.987614 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d125c-07f2-457e-a283-7f792d3aa00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:06.988757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d125c-07f2-457e-a283-7f792d3aa00b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:06.989049 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d125c-07f2-457e-a283-7f792d3aa00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:06.989930 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d125c-07f2-457e-a283-7f792d3aa00b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:06.990656 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d125c-07f2-457e-a283-7f792d3aa00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:06.992866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d125c-07f2-457e-a283-7f792d3aa00b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:07.009716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1396/2792] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:07.012955 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0997777-5846-42d8-82d6-a5b8af7456b6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:07.024666 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0997777-5846-42d8-82d6-a5b8af7456b6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:07.029482 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:07.030416 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:07.030705 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:07.030992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] PATH_INFO: `/v3/projects/935cd374b4b84b66a72fb204904cd570/users/78744e49097c47fe9556421949e178e9/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:07.033026 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935cd374b4b84b66a72fb204904cd570, user_id=78744e49097c47fe9556421949e178e9, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:07.037263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:07.054625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1397/2793] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:07 2022] PUT /identity/v3/projects/935cd374b4b84b66a72fb204904cd570/users/78744e49097c47fe9556421949e178e9/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:12.007469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa98a-f3ff-4413-acbe-f6c46e15cf2b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:12.007469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa98a-f3ff-4413-acbe-f6c46e15cf2b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:12.007469 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa98a-f3ff-4413-acbe-f6c46e15cf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:12.035333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0c4fa98a-f3ff-4413-acbe-f6c46e15cf2b None None] MFA Rules not processed for user `78744e49097c47fe9556421949e178e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:12.037377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c4fa98a-f3ff-4413-acbe-f6c46e15cf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:12.120412 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1397/2794] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:12.129279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:12.131373 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:12.198173 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe1606-88ae-4336-9ad8-638f15a71b80 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:12.202116 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998c7b05ebe64f5c95bcb86a49e673ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:12.205097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:12.205398 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:12.205850 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:12.280612 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:12.282289 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:12.292620 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1398/2795] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:12.398684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994858-0225-4005-8327-30f7a391236e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:12.399079 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994858-0225-4005-8327-30f7a391236e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:12.399375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994858-0225-4005-8327-30f7a391236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:12.436769 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4e994858-0225-4005-8327-30f7a391236e None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:12.438462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e994858-0225-4005-8327-30f7a391236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:12.551291 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1398/2796] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:12:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:12.578843 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:12.580355 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:12.675811 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea27c3-6f3f-4f6a-b17e-a2b5b6a27e25 service glance] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:12.687310 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:12.687994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:12.688281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:12.688560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:12.699170 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:12.701050 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:12.725403 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1399/2797] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:12:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:12:13.168753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e994858-0225-4005-8327-30f7a391236e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:13.170234 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e994858-0225-4005-8327-30f7a391236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:13.322735 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:13.359356 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:13.361407 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:13.366360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:13.453712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e994858-0225-4005-8327-30f7a391236e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:13.472985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15cf99-ecf2-438b-9b24-20a31b81895a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:13.474423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15cf99-ecf2-438b-9b24-20a31b81895a service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:13.478093 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15cf99-ecf2-438b-9b24-20a31b81895a service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:13.479866 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15cf99-ecf2-438b-9b24-20a31b81895a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:13.486834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aa15cf99-ecf2-438b-9b24-20a31b81895a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:13.513055 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15cf99-ecf2-438b-9b24-20a31b81895a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:13.515313 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15cf99-ecf2-438b-9b24-20a31b81895a service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:13.535072 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1399/2798] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:13.626196 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6511488-1627-4a18-843e-5fcbb665bfe9 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:13.649375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:13.653277 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:13.653596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:13.653898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:13.663226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:13.678445 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:13.680767 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:13.699361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1400/2799] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:15.065748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d91ac-b7b2-4417-ab7d-22be3159ba6b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:15.066256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d91ac-b7b2-4417-ab7d-22be3159ba6b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:15.066256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d91ac-b7b2-4417-ab7d-22be3159ba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:15.133377 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d34d91ac-b7b2-4417-ab7d-22be3159ba6b None None] MFA Rules not processed for user `64cb61cd1c734fb9abab9fe5860c0eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:15.141793 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d34d91ac-b7b2-4417-ab7d-22be3159ba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:15.310142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1400/2800] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:16.836930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:16.992366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c22864-c242-46b1-986f-58e2e28a1447 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:16.997930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:16.998938 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:16.999450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:16.999742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] PATH_INFO: `/v3/users/89b685b285e9451f92cbde272fca1122` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:17.000994 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b685b285e9451f92cbde272fca1122)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:17.003258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:17.084583 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b685b285e9451f92cbde272fca1122'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:17.085409 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b685b285e9451f92cbde272fca1122'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:17.094045 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b685b285e9451f92cbde272fca1122'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:17.104922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b685b285e9451f92cbde272fca1122'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:17.105909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b685b285e9451f92cbde272fca1122'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:17.113604 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:17.161656 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1401/2801] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:12:16 2022] DELETE /identity/v3/users/89b685b285e9451f92cbde272fca1122 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:17.167249 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cff26-687f-4b6b-a614-efbc921c0e08 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:17.168676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cff26-687f-4b6b-a614-efbc921c0e08 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:17.169150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cff26-687f-4b6b-a614-efbc921c0e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:17.218471 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-137cff26-687f-4b6b-a614-efbc921c0e08 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:17.222022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-137cff26-687f-4b6b-a614-efbc921c0e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:17.403130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1401/2802] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:17.422806 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:17.424597 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:17.560568 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d6a38-9d62-4bf2-a7b7-752953fe6427 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:17.570871 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40216dbd-40a0-47e9-893e-d87b34643c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:17.571556 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40216dbd-40a0-47e9-893e-d87b34643c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:17.571848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40216dbd-40a0-47e9-893e-d87b34643c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:17.572136 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40216dbd-40a0-47e9-893e-d87b34643c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:17.591097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40216dbd-40a0-47e9-893e-d87b34643c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:17.592898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40216dbd-40a0-47e9-893e-d87b34643c29 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:17.619776 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1402/2803] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:18.189334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cff26-687f-4b6b-a614-efbc921c0e08 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:18.195675 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-137cff26-687f-4b6b-a614-efbc921c0e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:18.224954 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cff26-687f-4b6b-a614-efbc921c0e08 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:18.233912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:18.234958 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:18.235354 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:18.235806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] PATH_INFO: `/v3/projects/3aa78a15a58d41dc8868337c7549a598` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:18.252633 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa78a15a58d41dc8868337c7549a598)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:18.256832 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:18.383269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa78a15a58d41dc8868337c7549a598', 'request_id': 'req-53367d4b-488b-4081-84aa-27d661c1d1d6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.404840 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa78a15a58d41dc8868337c7549a598', 'request_id': 'req-53367d4b-488b-4081-84aa-27d661c1d1d6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.409414 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:18.419030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa78a15a58d41dc8868337c7549a598', 'request_id': 'req-53367d4b-488b-4081-84aa-27d661c1d1d6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.438209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] The token cache is being invalidate because project 3aa78a15a58d41dc8868337c7549a598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:12:18.438874 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.441961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.444608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1402/2804] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:12:18 2022] DELETE /identity/v3/projects/3aa78a15a58d41dc8868337c7549a598 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:18.448390 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40216dbd-40a0-47e9-893e-d87b34643c29 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:18.468378 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40216dbd-40a0-47e9-893e-d87b34643c29 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:18.611900 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:18.613039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:18.613420 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:18.613963 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] PATH_INFO: `/v3/users/30e1093baf7248beb215ed75fd25f0f1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:18.617267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e1093baf7248beb215ed75fd25f0f1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:18.622419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:18.750241 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e1093baf7248beb215ed75fd25f0f1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.751463 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e1093baf7248beb215ed75fd25f0f1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.776949 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e1093baf7248beb215ed75fd25f0f1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.809703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e1093baf7248beb215ed75fd25f0f1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.810336 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd060b8-a95d-4414-8cf3-9a09e5074e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e1093baf7248beb215ed75fd25f0f1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:18.871698 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1403/2805] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:12:18 2022] DELETE /identity/v3/users/30e1093baf7248beb215ed75fd25f0f1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:12:20.487807 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:20.490332 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:20.519731 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53367d4b-488b-4081-84aa-27d661c1d1d6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:20.716191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:20.718259 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:20.718818 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:20.719360 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] PATH_INFO: `/v3/projects/895a523c4e4f408293425807da18cc8b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:20.722667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895a523c4e4f408293425807da18cc8b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:20.730058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:20.842713 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895a523c4e4f408293425807da18cc8b', 'request_id': 'req-c74ef02b-acb3-45ae-87ab-f76fba418257'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:20.859608 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895a523c4e4f408293425807da18cc8b', 'request_id': 'req-c74ef02b-acb3-45ae-87ab-f76fba418257'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:20.873300 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895a523c4e4f408293425807da18cc8b', 'request_id': 'req-c74ef02b-acb3-45ae-87ab-f76fba418257'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:20.891461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] The token cache is being invalidate because project 895a523c4e4f408293425807da18cc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:12:20.891761 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:20.892699 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c74ef02b-acb3-45ae-87ab-f76fba418257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:20.900130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1403/2806] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:12:20 2022] DELETE /identity/v3/projects/895a523c4e4f408293425807da18cc8b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:20.901498 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4cb3-26b9-4606-9449-19caa7acb920 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:20.902016 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4cb3-26b9-4606-9449-19caa7acb920 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:20.902111 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4cb3-26b9-4606-9449-19caa7acb920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:20.929831 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:20.992548 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-232d4cb3-26b9-4606-9449-19caa7acb920 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:20.994106 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-232d4cb3-26b9-4606-9449-19caa7acb920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:21.076760 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1404/2807] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:21.086337 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d7f37-3511-4f5f-8ea4-57ccd6a9c9e3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:21.086612 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d7f37-3511-4f5f-8ea4-57ccd6a9c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:21.086902 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d7f37-3511-4f5f-8ea4-57ccd6a9c9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:21.124112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-589d7f37-3511-4f5f-8ea4-57ccd6a9c9e3 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:21.127519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-589d7f37-3511-4f5f-8ea4-57ccd6a9c9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:21.166384 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d4cb3-26b9-4606-9449-19caa7acb920 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:21.167616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1404/2808] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:21.185406 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d4cb3-26b9-4606-9449-19caa7acb920 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:21.206362 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:21.207224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:21.208584 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:21.209178 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:21.210258 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:12:21.210711 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:21.212455 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:21.247898 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1405/2809] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:12:21.253911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d7f37-3511-4f5f-8ea4-57ccd6a9c9e3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:21.289238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d7f37-3511-4f5f-8ea4-57ccd6a9c9e3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:21.295254 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e259b42-5e09-4f0d-8f5d-99086227028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:21.295953 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259b42-5e09-4f0d-8f5d-99086227028e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:21.296244 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259b42-5e09-4f0d-8f5d-99086227028e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:21.296529 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259b42-5e09-4f0d-8f5d-99086227028e admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:21.297431 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e259b42-5e09-4f0d-8f5d-99086227028e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:21.299878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e259b42-5e09-4f0d-8f5d-99086227028e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:21.360951 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1405/2810] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:12:21 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:21.361911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:21.388360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600e25b-2f22-4592-b540-b4e2a7466db0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:21.562424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5ecfa-f509-4c6d-b466-6afae94be3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:21.563436 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ecfa-f509-4c6d-b466-6afae94be3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:21.564511 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ecfa-f509-4c6d-b466-6afae94be3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:21.566056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ecfa-f509-4c6d-b466-6afae94be3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:21.569448 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5ecfa-f509-4c6d-b466-6afae94be3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:21.575156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5ecfa-f509-4c6d-b466-6afae94be3b2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:21.620670 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1406/2811] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:12:21 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:21.625631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e259b42-5e09-4f0d-8f5d-99086227028e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:21.644007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e259b42-5e09-4f0d-8f5d-99086227028e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:21.657086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73407-61e5-4b82-abad-37c76fa670e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:21.658691 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73407-61e5-4b82-abad-37c76fa670e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:21.659191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73407-61e5-4b82-abad-37c76fa670e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:21.659896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73407-61e5-4b82-abad-37c76fa670e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:21.661631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73407-61e5-4b82-abad-37c76fa670e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:21.663554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73407-61e5-4b82-abad-37c76fa670e4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:21.691783 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1406/2812] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:21.697288 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5ecfa-f509-4c6d-b466-6afae94be3b2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:21.709816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5ecfa-f509-4c6d-b466-6afae94be3b2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:21.718303 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031bad0-20ae-459c-87e7-1b6ce84b604c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:21.719102 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031bad0-20ae-459c-87e7-1b6ce84b604c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:21.719490 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031bad0-20ae-459c-87e7-1b6ce84b604c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:21.719869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031bad0-20ae-459c-87e7-1b6ce84b604c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:21.721071 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031bad0-20ae-459c-87e7-1b6ce84b604c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:21.725926 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031bad0-20ae-459c-87e7-1b6ce84b604c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:21.752350 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73407-61e5-4b82-abad-37c76fa670e4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:21.759504 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1407/2813] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:21.774556 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73407-61e5-4b82-abad-37c76fa670e4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:21.780115 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:21.781382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:21.781935 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:21.782702 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] PATH_INFO: `/v3/projects/5726f64294b54f6bb37a6a9a2c1f284e/users/9cc4d2bf07a44c80bf59ff5cfb56210d/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:21.831547 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5726f64294b54f6bb37a6a9a2c1f284e, user_id=9cc4d2bf07a44c80bf59ff5cfb56210d, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:21.836032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:21.872145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1407/2814] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:21 2022] PUT /identity/v3/projects/5726f64294b54f6bb37a6a9a2c1f284e/users/9cc4d2bf07a44c80bf59ff5cfb56210d/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:21.886255 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949a79-aaa1-4991-92ed-9d89d62de8ab None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:21.886669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949a79-aaa1-4991-92ed-9d89d62de8ab None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:21.887074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949a79-aaa1-4991-92ed-9d89d62de8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:21.944495 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:21.946366 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:21.965593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-89949a79-aaa1-4991-92ed-9d89d62de8ab None None] MFA Rules not processed for user `9cc4d2bf07a44c80bf59ff5cfb56210d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:21.967226 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-89949a79-aaa1-4991-92ed-9d89d62de8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:21.992371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:22.124518 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:22.165668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1408/2815] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:22.170588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89949a79-aaa1-4991-92ed-9d89d62de8ab None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:22.192979 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05803b-5121-44d6-8804-9c27d2730b65 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:22.201205 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:22.202078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:22.202490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:22.202876 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:22.206275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:22.241971 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:22.243765 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:22.259016 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1408/2816] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:12:22.375942 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89949a79-aaa1-4991-92ed-9d89d62de8ab None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:22.387043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3d7f1-448b-4091-a3e0-2c38fc8a21a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:22.388127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d7f1-448b-4091-a3e0-2c38fc8a21a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:22.388523 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d7f1-448b-4091-a3e0-2c38fc8a21a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:22.388911 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d7f1-448b-4091-a3e0-2c38fc8a21a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:22.389853 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3d7f1-448b-4091-a3e0-2c38fc8a21a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:22.398296 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3d7f1-448b-4091-a3e0-2c38fc8a21a1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:22.441616 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1409/2817] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:12:22 2022] POST /identity/v3/projects => generated 381 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:22.446725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:22.461353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c75b7-60d3-458d-bdfc-254771f8d631 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:22.560429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a155e-78bf-4a81-bfd8-905ac951499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:22.561157 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a155e-78bf-4a81-bfd8-905ac951499d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:22.561444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a155e-78bf-4a81-bfd8-905ac951499d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:22.561756 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a155e-78bf-4a81-bfd8-905ac951499d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:22.562466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a155e-78bf-4a81-bfd8-905ac951499d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:22.564419 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a155e-78bf-4a81-bfd8-905ac951499d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:22.611239 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1409/2818] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:12:22 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:22.616053 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3d7f1-448b-4091-a3e0-2c38fc8a21a1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:22.628101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3d7f1-448b-4091-a3e0-2c38fc8a21a1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:22.634812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42379b1-26bf-4240-878b-e4634e8fd4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:22.635725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42379b1-26bf-4240-878b-e4634e8fd4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:22.636017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42379b1-26bf-4240-878b-e4634e8fd4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:22.636295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42379b1-26bf-4240-878b-e4634e8fd4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:22.637029 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42379b1-26bf-4240-878b-e4634e8fd4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:22.638668 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42379b1-26bf-4240-878b-e4634e8fd4b1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:22.655592 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1410/2819] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:22.659549 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a155e-78bf-4a81-bfd8-905ac951499d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:22.683743 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a155e-78bf-4a81-bfd8-905ac951499d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:22.696269 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021c564-80d0-4522-b31f-25647e837fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:22.697197 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c564-80d0-4522-b31f-25647e837fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:22.697488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c564-80d0-4522-b31f-25647e837fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:22.697820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c564-80d0-4522-b31f-25647e837fe5 admin admin] PATH_INFO: `/v3/projects/fbfe8d1414ec478cae07bfdac792cb62/users/d173e76403dc4e6fabcd6075161f6cfb/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:22.726092 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021c564-80d0-4522-b31f-25647e837fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfe8d1414ec478cae07bfdac792cb62, user_id=d173e76403dc4e6fabcd6075161f6cfb, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:22.729059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021c564-80d0-4522-b31f-25647e837fe5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:22.757579 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1410/2820] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:22 2022] PUT /identity/v3/projects/fbfe8d1414ec478cae07bfdac792cb62/users/d173e76403dc4e6fabcd6075161f6cfb/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:22.760081 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42379b1-26bf-4240-878b-e4634e8fd4b1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:22.776375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42379b1-26bf-4240-878b-e4634e8fd4b1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:22.841649 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c31bb-ba9d-4e5c-b5be-e7f25023b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:22.844783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c31bb-ba9d-4e5c-b5be-e7f25023b472 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:22.844783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c31bb-ba9d-4e5c-b5be-e7f25023b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:22.844783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c31bb-ba9d-4e5c-b5be-e7f25023b472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:22.844783 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c31bb-ba9d-4e5c-b5be-e7f25023b472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:22.845782 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c31bb-ba9d-4e5c-b5be-e7f25023b472 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:22.862300 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1411/2821] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:22.865651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021c564-80d0-4522-b31f-25647e837fe5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:22.874897 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021c564-80d0-4522-b31f-25647e837fe5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:22.887668 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:22.888498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:22.888784 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:22.889064 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] PATH_INFO: `/v3/projects/fbfe8d1414ec478cae07bfdac792cb62/users/d173e76403dc4e6fabcd6075161f6cfb/roles/4343857f7f764235b4cb9f4f7de7c235` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:22.891122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfe8d1414ec478cae07bfdac792cb62, user_id=d173e76403dc4e6fabcd6075161f6cfb, role_id=4343857f7f764235b4cb9f4f7de7c235)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:22.893781 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:22.905684 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1411/2822] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:22 2022] PUT /identity/v3/projects/fbfe8d1414ec478cae07bfdac792cb62/users/d173e76403dc4e6fabcd6075161f6cfb/roles/4343857f7f764235b4cb9f4f7de7c235 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:22.978203 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ea45e-a54a-4ac9-9836-401a0838c91e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:22.978743 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ea45e-a54a-4ac9-9836-401a0838c91e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:22.978841 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ea45e-a54a-4ac9-9836-401a0838c91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:23.012441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-640ea45e-a54a-4ac9-9836-401a0838c91e None None] MFA Rules not processed for user `d173e76403dc4e6fabcd6075161f6cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:23.012441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-640ea45e-a54a-4ac9-9836-401a0838c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:23.068789 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:23.097204 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1412/2823] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:23.109846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:23.111586 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:23.188708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cce1c7-fef0-4191-9375-2eb471a4d61c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:23.192931 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b5a24-563d-4a7d-a57d-9c4804cf0e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:23.193883 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5a24-563d-4a7d-a57d-9c4804cf0e31 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:23.194198 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5a24-563d-4a7d-a57d-9c4804cf0e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:23.194484 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5a24-563d-4a7d-a57d-9c4804cf0e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:23.201108 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:23.209228 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b5a24-563d-4a7d-a57d-9c4804cf0e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:23.212382 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b5a24-563d-4a7d-a57d-9c4804cf0e31 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:23.227961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1412/2824] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:23.305818 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ea45e-a54a-4ac9-9836-401a0838c91e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:23.315892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ea45e-a54a-4ac9-9836-401a0838c91e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:23.324043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd52a7f-1f6b-4cd5-a881-c0d01c4123ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:23.324848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd52a7f-1f6b-4cd5-a881-c0d01c4123ac service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:23.325262 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd52a7f-1f6b-4cd5-a881-c0d01c4123ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:23.325672 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd52a7f-1f6b-4cd5-a881-c0d01c4123ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:23.412475 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd52a7f-1f6b-4cd5-a881-c0d01c4123ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:23.414268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd52a7f-1f6b-4cd5-a881-c0d01c4123ac service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:23.431032 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1413/2825] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:23.830965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b5a24-563d-4a7d-a57d-9c4804cf0e31 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:23.942355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b5a24-563d-4a7d-a57d-9c4804cf0e31 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:23.947537 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:23.948806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:23.949275 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:23.949747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] PATH_INFO: `/v3/users/9cc4d2bf07a44c80bf59ff5cfb56210d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:23.951147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc4d2bf07a44c80bf59ff5cfb56210d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:23.953344 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:24.044826 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc4d2bf07a44c80bf59ff5cfb56210d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.045846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc4d2bf07a44c80bf59ff5cfb56210d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.055821 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc4d2bf07a44c80bf59ff5cfb56210d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.086927 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc4d2bf07a44c80bf59ff5cfb56210d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.097856 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc4d2bf07a44c80bf59ff5cfb56210d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.105533 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1413/2826] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:12:23 2022] DELETE /identity/v3/users/9cc4d2bf07a44c80bf59ff5cfb56210d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:24.110063 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcca79-b348-4497-92ba-9d7b55919e12 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:24.110547 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcca79-b348-4497-92ba-9d7b55919e12 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:24.110772 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcca79-b348-4497-92ba-9d7b55919e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:24.133531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3cfcca79-b348-4497-92ba-9d7b55919e12 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:24.135531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3cfcca79-b348-4497-92ba-9d7b55919e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:24.228014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1414/2827] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:24.237969 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:24.239550 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:24.304659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c622a0-1850-4c52-9ccd-4a092a707afb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:24.310373 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749baf2-35d4-446b-9e84-4038236f6d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:24.311306 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749baf2-35d4-446b-9e84-4038236f6d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:24.311674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749baf2-35d4-446b-9e84-4038236f6d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:24.312209 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749baf2-35d4-446b-9e84-4038236f6d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:24.323307 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749baf2-35d4-446b-9e84-4038236f6d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:24.324855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749baf2-35d4-446b-9e84-4038236f6d27 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:24.336297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1414/2828] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:24.665488 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcca79-b348-4497-92ba-9d7b55919e12 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:24.666997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3cfcca79-b348-4497-92ba-9d7b55919e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:24.695825 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcca79-b348-4497-92ba-9d7b55919e12 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:24.703892 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:24.704778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:24.705064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:24.705375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] PATH_INFO: `/v3/projects/5726f64294b54f6bb37a6a9a2c1f284e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:24.706618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5726f64294b54f6bb37a6a9a2c1f284e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:24.709085 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:24.790292 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5726f64294b54f6bb37a6a9a2c1f284e', 'request_id': 'req-f87d31bd-0822-49ca-a960-17620c5e6be8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.797146 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5726f64294b54f6bb37a6a9a2c1f284e', 'request_id': 'req-f87d31bd-0822-49ca-a960-17620c5e6be8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.806823 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5726f64294b54f6bb37a6a9a2c1f284e', 'request_id': 'req-f87d31bd-0822-49ca-a960-17620c5e6be8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.828055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] The token cache is being invalidate because project 5726f64294b54f6bb37a6a9a2c1f284e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:12:24.828464 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.829272 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.831510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1415/2829] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:12:24 2022] DELETE /identity/v3/projects/5726f64294b54f6bb37a6a9a2c1f284e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:24.836112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749baf2-35d4-446b-9e84-4038236f6d27 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:24.849679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749baf2-35d4-446b-9e84-4038236f6d27 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:24.862750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:24.931676 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:24.932591 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:24.932881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:24.935575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] PATH_INFO: `/v3/users/d173e76403dc4e6fabcd6075161f6cfb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:24.936965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d173e76403dc4e6fabcd6075161f6cfb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:24.938974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:24.997577 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd173e76403dc4e6fabcd6075161f6cfb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:24.998236 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd173e76403dc4e6fabcd6075161f6cfb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.007122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd173e76403dc4e6fabcd6075161f6cfb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.020773 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd173e76403dc4e6fabcd6075161f6cfb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.029191 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c69a86ab-7e8a-40ee-852d-fd73935ef1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd173e76403dc4e6fabcd6075161f6cfb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.037631 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1415/2830] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:12:24 2022] DELETE /identity/v3/users/d173e76403dc4e6fabcd6075161f6cfb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:25.367739 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:25.369328 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:25.382167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:25.385657 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d31bd-0822-49ca-a960-17620c5e6be8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:25.467923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:25.468864 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:25.469154 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:25.470503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] PATH_INFO: `/v3/projects/fbfe8d1414ec478cae07bfdac792cb62` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:25.471441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfe8d1414ec478cae07bfdac792cb62)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:25.474394 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:25.549749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfe8d1414ec478cae07bfdac792cb62', 'request_id': 'req-7611cf90-f838-48e8-88cd-d7a0296c18da'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.560127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfe8d1414ec478cae07bfdac792cb62', 'request_id': 'req-7611cf90-f838-48e8-88cd-d7a0296c18da'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.572180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfe8d1414ec478cae07bfdac792cb62', 'request_id': 'req-7611cf90-f838-48e8-88cd-d7a0296c18da'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.590000 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] The token cache is being invalidate because project fbfe8d1414ec478cae07bfdac792cb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:12:25.590625 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.591870 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7611cf90-f838-48e8-88cd-d7a0296c18da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:25.594703 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1416/2831] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:12:25 2022] DELETE /identity/v3/projects/fbfe8d1414ec478cae07bfdac792cb62 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:25.600461 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e101d9-8daf-4f62-8386-66f2b8e24f6d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:25.601283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e101d9-8daf-4f62-8386-66f2b8e24f6d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:25.601283 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e101d9-8daf-4f62-8386-66f2b8e24f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:25.623804 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a2e101d9-8daf-4f62-8386-66f2b8e24f6d None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:25.625509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a2e101d9-8daf-4f62-8386-66f2b8e24f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:25.713315 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1416/2832] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:25.721046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6fe7-ac9d-4b7f-b2ac-e123d6057502 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:25.721334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6fe7-ac9d-4b7f-b2ac-e123d6057502 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:25.721664 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6fe7-ac9d-4b7f-b2ac-e123d6057502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:25.742078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1e4e6fe7-ac9d-4b7f-b2ac-e123d6057502 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:25.743308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1e4e6fe7-ac9d-4b7f-b2ac-e123d6057502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:25.751897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1417/2833] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:25.757208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e101d9-8daf-4f62-8386-66f2b8e24f6d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:25.767396 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e101d9-8daf-4f62-8386-66f2b8e24f6d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:25.772490 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:25.773160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:25.773444 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:25.773755 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:25.774488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:12:25.774796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:25.777751 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:25.790257 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1417/2834] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:12:25.794808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e6fe7-ac9d-4b7f-b2ac-e123d6057502 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:25.804940 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e6fe7-ac9d-4b7f-b2ac-e123d6057502 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:25.811683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd178a0-43a8-4b21-bef2-76c8dd1c13ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:25.811683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd178a0-43a8-4b21-bef2-76c8dd1c13ff admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:25.811683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd178a0-43a8-4b21-bef2-76c8dd1c13ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:25.811683 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd178a0-43a8-4b21-bef2-76c8dd1c13ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:25.812126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd178a0-43a8-4b21-bef2-76c8dd1c13ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:25.814022 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd178a0-43a8-4b21-bef2-76c8dd1c13ff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:25.847710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1418/2835] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:12:25 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:25.850278 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:25.860939 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee5fa9-3fe3-498a-bd33-3495d1bc7b5c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:25.882938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:25.928145 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5645-d1ea-4b21-9613-df17e26739f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:25.928820 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5645-d1ea-4b21-9613-df17e26739f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:25.929114 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5645-d1ea-4b21-9613-df17e26739f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:25.929589 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5645-d1ea-4b21-9613-df17e26739f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:25.930312 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf5645-d1ea-4b21-9613-df17e26739f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:25.932519 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf5645-d1ea-4b21-9613-df17e26739f7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:25.966435 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1418/2836] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:12:25 2022] POST /identity/v3/users => generated 280 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:25.970256 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd178a0-43a8-4b21-bef2-76c8dd1c13ff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:25.982386 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd178a0-43a8-4b21-bef2-76c8dd1c13ff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:25.987729 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e283b-be0d-400e-8c8e-ba4c72e4e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:25.988565 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e283b-be0d-400e-8c8e-ba4c72e4e198 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:25.988798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e283b-be0d-400e-8c8e-ba4c72e4e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:25.989957 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e283b-be0d-400e-8c8e-ba4c72e4e198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:25.990728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e283b-be0d-400e-8c8e-ba4c72e4e198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:25.992334 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e283b-be0d-400e-8c8e-ba4c72e4e198 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:26.008953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1419/2837] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:26.009936 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5645-d1ea-4b21-9613-df17e26739f7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:26.026389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5645-d1ea-4b21-9613-df17e26739f7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:26.034393 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdc1e7-4a4f-4b25-9d47-34a5e160ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:26.035422 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc1e7-4a4f-4b25-9d47-34a5e160ce57 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:26.036575 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc1e7-4a4f-4b25-9d47-34a5e160ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:26.037445 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc1e7-4a4f-4b25-9d47-34a5e160ce57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:26.038386 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdc1e7-4a4f-4b25-9d47-34a5e160ce57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:26.040303 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdc1e7-4a4f-4b25-9d47-34a5e160ce57 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:26.058089 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1419/2838] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:12:26.059630 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e283b-be0d-400e-8c8e-ba4c72e4e198 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:26.078714 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e283b-be0d-400e-8c8e-ba4c72e4e198 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:26.084970 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:26.085910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:26.086194 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:26.086505 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] PATH_INFO: `/v3/projects/23d8eb311afe49e8ada93e7d9df95fa9/users/0b062e4ade264445a0f6eaa55a0fe52d/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:26.109858 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d8eb311afe49e8ada93e7d9df95fa9, user_id=0b062e4ade264445a0f6eaa55a0fe52d, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:26.112528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:26.144389 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1420/2839] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:26 2022] PUT /identity/v3/projects/23d8eb311afe49e8ada93e7d9df95fa9/users/0b062e4ade264445a0f6eaa55a0fe52d/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:12:26.144671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71268d-762b-47dc-97fc-090749430d17 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:26.144978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71268d-762b-47dc-97fc-090749430d17 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:26.145885 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71268d-762b-47dc-97fc-090749430d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:26.179040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ac71268d-762b-47dc-97fc-090749430d17 None None] MFA Rules not processed for user `0b062e4ade264445a0f6eaa55a0fe52d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:26.180721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ac71268d-762b-47dc-97fc-090749430d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:26.263183 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1420/2840] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:12:26.292765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:26.295819 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:26.345295 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:26.408596 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2a73-0d36-44fe-bb1c-03a247dce4f0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:26.415700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cf27d-85a8-4d04-a6d9-6a2fac806598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:26.416468 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cf27d-85a8-4d04-a6d9-6a2fac806598 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:26.416788 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cf27d-85a8-4d04-a6d9-6a2fac806598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:26.417068 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cf27d-85a8-4d04-a6d9-6a2fac806598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:26.427192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cf27d-85a8-4d04-a6d9-6a2fac806598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:26.429290 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cf27d-85a8-4d04-a6d9-6a2fac806598 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:26.439461 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1421/2841] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:26 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:26.455325 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71268d-762b-47dc-97fc-090749430d17 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:26.534978 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71268d-762b-47dc-97fc-090749430d17 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:26.540542 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:26.541476 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:26.541846 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:26.542147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] PATH_INFO: `/v3/users/0b062e4ade264445a0f6eaa55a0fe52d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:26.543502 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b062e4ade264445a0f6eaa55a0fe52d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:26.545663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:26.591304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:26.611670 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b062e4ade264445a0f6eaa55a0fe52d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:26.612410 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b062e4ade264445a0f6eaa55a0fe52d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:26.621975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b062e4ade264445a0f6eaa55a0fe52d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:26.636812 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b062e4ade264445a0f6eaa55a0fe52d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:26.644465 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b062e4ade264445a0f6eaa55a0fe52d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:26.651583 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1421/2842] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:12:26 2022] DELETE /identity/v3/users/0b062e4ade264445a0f6eaa55a0fe52d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:26.656180 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f6cf-11c7-43c5-bbce-d591f5358ad1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:26.656477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f6cf-11c7-43c5-bbce-d591f5358ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:26.656765 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f6cf-11c7-43c5-bbce-d591f5358ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:26.680527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dea5f6cf-11c7-43c5-bbce-d591f5358ad1 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:26.682044 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dea5f6cf-11c7-43c5-bbce-d591f5358ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:26.756043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1422/2843] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:26.766018 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:26.767498 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:26.871825 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46b8a-3273-4c12-a066-653c006fc00a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:26.876177 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f0283-0fc7-4f32-bcab-ac0782e66c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:26.876849 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0283-0fc7-4f32-bcab-ac0782e66c3e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:26.877142 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0283-0fc7-4f32-bcab-ac0782e66c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:26.877429 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0283-0fc7-4f32-bcab-ac0782e66c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:26.887455 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0283-0fc7-4f32-bcab-ac0782e66c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:26.888918 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0283-0fc7-4f32-bcab-ac0782e66c3e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:26.898957 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1422/2844] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:27.219324 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f6cf-11c7-43c5-bbce-d591f5358ad1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:27.221192 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dea5f6cf-11c7-43c5-bbce-d591f5358ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:27.241229 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f6cf-11c7-43c5-bbce-d591f5358ad1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:27.256745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:27.257839 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.258316 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.258761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] PATH_INFO: `/v3/projects/23d8eb311afe49e8ada93e7d9df95fa9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.261415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d8eb311afe49e8ada93e7d9df95fa9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:27.263833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:27.326764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d8eb311afe49e8ada93e7d9df95fa9', 'request_id': 'req-0647719b-59f4-42a5-baeb-43300fe6c7c9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:27.339918 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d8eb311afe49e8ada93e7d9df95fa9', 'request_id': 'req-0647719b-59f4-42a5-baeb-43300fe6c7c9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:27.351528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d8eb311afe49e8ada93e7d9df95fa9', 'request_id': 'req-0647719b-59f4-42a5-baeb-43300fe6c7c9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:27.376137 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] The token cache is being invalidate because project 23d8eb311afe49e8ada93e7d9df95fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:12:27.376559 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:27.377058 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0647719b-59f4-42a5-baeb-43300fe6c7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:12:27.378693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1423/2845] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:12:27 2022] DELETE /identity/v3/projects/23d8eb311afe49e8ada93e7d9df95fa9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:12:27.383915 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c782-fbea-4b85-85f4-418724ae47c0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.384284 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c782-fbea-4b85-85f4-418724ae47c0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.384661 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c782-fbea-4b85-85f4-418724ae47c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.409297 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3a59c782-fbea-4b85-85f4-418724ae47c0 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:27.410792 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3a59c782-fbea-4b85-85f4-418724ae47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:27.475105 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1423/2846] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:12:27.484048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275d36-3fe7-430c-bc9f-78549a5d2923 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.484444 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275d36-3fe7-430c-bc9f-78549a5d2923 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.484613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275d36-3fe7-430c-bc9f-78549a5d2923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.502998 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-34275d36-3fe7-430c-bc9f-78549a5d2923 None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:27.504197 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-34275d36-3fe7-430c-bc9f-78549a5d2923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:27.513749 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1424/2847] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:27.518757 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59c782-fbea-4b85-85f4-418724ae47c0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:27.539529 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4bc0-30e8-4e09-8a79-da2381c12bf0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.540052 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4bc0-30e8-4e09-8a79-da2381c12bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.540527 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4bc0-30e8-4e09-8a79-da2381c12bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.540944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59c782-fbea-4b85-85f4-418724ae47c0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:27.546063 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:27.546748 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.547040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.547327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.548111 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:12:27.548505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:27.550509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:27.568716 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1424/2848] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 8 13:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:12:27.569483 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c4ef4bc0-30e8-4e09-8a79-da2381c12bf0 None None] MFA Rules not processed for user `738bbccf2dbd4f38b02c981d11d45834`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:27.571357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c4ef4bc0-30e8-4e09-8a79-da2381c12bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:27.572721 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:27.585479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aabc9-496b-4f90-a2a3-0548b3214ade admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:27.591453 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f740-8037-409e-a9eb-d0fd5a236df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:27.592371 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f740-8037-409e-a9eb-d0fd5a236df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.592886 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f740-8037-409e-a9eb-d0fd5a236df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.593381 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f740-8037-409e-a9eb-d0fd5a236df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.594342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f740-8037-409e-a9eb-d0fd5a236df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:27.596604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f740-8037-409e-a9eb-d0fd5a236df3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:27.606281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:27.632777 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1425/2849] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 8 13:12:27 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:12:27.636696 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f740-8037-409e-a9eb-d0fd5a236df3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:27.653593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1425/2850] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:27.658943 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:27.727980 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f740-8037-409e-a9eb-d0fd5a236df3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:27.733256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238785f-568e-4ba5-9780-d1526fc66ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:27.733914 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238785f-568e-4ba5-9780-d1526fc66ede admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.734207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238785f-568e-4ba5-9780-d1526fc66ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.734509 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238785f-568e-4ba5-9780-d1526fc66ede admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.735508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238785f-568e-4ba5-9780-d1526fc66ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:27.737462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238785f-568e-4ba5-9780-d1526fc66ede admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:27.773568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1426/2851] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 8 13:12:27 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:12:27.775075 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef4bc0-30e8-4e09-8a79-da2381c12bf0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:27.786587 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef4bc0-30e8-4e09-8a79-da2381c12bf0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:27.791531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaf998-c638-41f8-a9a9-e9a4882a9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:27.792787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaf998-c638-41f8-a9a9-e9a4882a9d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.792787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaf998-c638-41f8-a9a9-e9a4882a9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.792787 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaf998-c638-41f8-a9a9-e9a4882a9d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.793470 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaf998-c638-41f8-a9a9-e9a4882a9d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:27.795101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaf998-c638-41f8-a9a9-e9a4882a9d24 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:27.806702 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1426/2852] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:27.810671 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238785f-568e-4ba5-9780-d1526fc66ede admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:27.823470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238785f-568e-4ba5-9780-d1526fc66ede admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:27.828959 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd9a22-2aa6-41e0-ab0a-35e4f2cd06e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:27.829740 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9a22-2aa6-41e0-ab0a-35e4f2cd06e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.830162 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9a22-2aa6-41e0-ab0a-35e4f2cd06e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.830543 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9a22-2aa6-41e0-ab0a-35e4f2cd06e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.831358 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd9a22-2aa6-41e0-ab0a-35e4f2cd06e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:27.833150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd9a22-2aa6-41e0-ab0a-35e4f2cd06e7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:27.845225 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1427/2853] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 8 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:12:27.849768 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaf998-c638-41f8-a9a9-e9a4882a9d24 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:27.860636 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaf998-c638-41f8-a9a9-e9a4882a9d24 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:27.866855 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:27.867803 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.868031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.868439 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] PATH_INFO: `/v3/projects/545a71ece3ce4ed3badc82bf4fffd032/users/b3c2b47268f04261ac7ad2a9a3522d17/roles/a73bec0a8208424e89eba3acdec2e49a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.888701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545a71ece3ce4ed3badc82bf4fffd032, user_id=b3c2b47268f04261ac7ad2a9a3522d17, role_id=a73bec0a8208424e89eba3acdec2e49a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:27.891344 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:27.905521 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1427/2854] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 8 13:12:27 2022] PUT /identity/v3/projects/545a71ece3ce4ed3badc82bf4fffd032/users/b3c2b47268f04261ac7ad2a9a3522d17/roles/a73bec0a8208424e89eba3acdec2e49a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:12:27.916558 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9578f-be7e-4492-9a34-b94cf1f16a66 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:27.917041 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9578f-be7e-4492-9a34-b94cf1f16a66 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:27.917248 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9578f-be7e-4492-9a34-b94cf1f16a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:27.940491 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:27.942680 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:27.947392 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3eb9578f-be7e-4492-9a34-b94cf1f16a66 None None] MFA Rules not processed for user `b3c2b47268f04261ac7ad2a9a3522d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:27.948649 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3eb9578f-be7e-4492-9a34-b94cf1f16a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:28.001392 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b56e0-531f-48b6-98d7-58739586dae7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:28.005269 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eb8f8-b4f9-40a2-b283-918d851016bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:28.005951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb8f8-b4f9-40a2-b283-918d851016bd service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:28.006238 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb8f8-b4f9-40a2-b283-918d851016bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:28.006544 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb8f8-b4f9-40a2-b283-918d851016bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:28.008415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-924eb8f8-b4f9-40a2-b283-918d851016bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:28.015336 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1428/2855] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:12:28.018824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eb8f8-b4f9-40a2-b283-918d851016bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:28.021463 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eb8f8-b4f9-40a2-b283-918d851016bd service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:28.027621 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9578f-be7e-4492-9a34-b94cf1f16a66 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:28.029021 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3eb9578f-be7e-4492-9a34-b94cf1f16a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:28.030751 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1428/2856] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:28.088436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9578f-be7e-4492-9a34-b94cf1f16a66 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:28.092367 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:28.093032 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:28.093330 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:28.093667 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:28.102432 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:28.103881 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:28.113026 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1429/2857] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:12:29.562516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b957bb-bb38-4df1-9106-b4815af8a631 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:29.563014 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b957bb-bb38-4df1-9106-b4815af8a631 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:29.563117 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b957bb-bb38-4df1-9106-b4815af8a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:29.579845 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-48b957bb-bb38-4df1-9106-b4815af8a631 None None] MFA Rules not processed for user `b3c2b47268f04261ac7ad2a9a3522d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:29.581074 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-48b957bb-bb38-4df1-9106-b4815af8a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:29.588600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1429/2858] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:12:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:29.955309 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:29.956916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:29.997629 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:30.049834 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd03fb-6371-410d-8297-23c16d6e067f service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:30.055681 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:30.056408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:30.056766 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:30.057113 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:30.058945 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:30.072054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:30.073663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:30.085266 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1430/2859] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:30.946912 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132fa5c-2ea9-4873-b2b3-926c03607ced None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:30.947450 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132fa5c-2ea9-4873-b2b3-926c03607ced None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:30.947573 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132fa5c-2ea9-4873-b2b3-926c03607ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:30.968230 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3132fa5c-2ea9-4873-b2b3-926c03607ced None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:12:30.969697 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3132fa5c-2ea9-4873-b2b3-926c03607ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:31.068199 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1430/2860] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:12:31.086602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:31.088865 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:31.217647 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daae4e-cd81-42b0-b964-20dd5cca9bd3 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:31.222764 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:31.223343 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:31.223625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:31.223904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:31.233262 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:31.235086 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:31.248644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1431/2861] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:12:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:12:41.056043 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:41.244263 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=53 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:42.818956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132fa5c-2ea9-4873-b2b3-926c03607ced None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:42.840929 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132fa5c-2ea9-4873-b2b3-926c03607ced None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:42.850238 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13e2f-d904-4ae5-97f4-7d0426dcf6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:42.851046 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13e2f-d904-4ae5-97f4-7d0426dcf6bc service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:42.851453 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13e2f-d904-4ae5-97f4-7d0426dcf6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:42.851833 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13e2f-d904-4ae5-97f4-7d0426dcf6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:42.855415 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fcd13e2f-d904-4ae5-97f4-7d0426dcf6bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:42.947189 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13e2f-d904-4ae5-97f4-7d0426dcf6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:42.948828 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13e2f-d904-4ae5-97f4-7d0426dcf6bc service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:42.963113 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1431/2862] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:12:52.955124 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=30 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:12:59.661362 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:12:59.663911 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:59.780359 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781fd3-29bc-4a87-a3c8-ed5314043cc2 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:12:59.786602 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:12:59.787278 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:12:59.787569 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:12:59.787857 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:12:59.789711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:12:59.802370 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:12:59.803984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:12:59.818977 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1432/2863] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:13:00.825357 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e12d-b777-4c84-b3fe-8f8b6d4fa8f4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:00.825861 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e12d-b777-4c84-b3fe-8f8b6d4fa8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:00.825975 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e12d-b777-4c84-b3fe-8f8b6d4fa8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:00.843728 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8bc4e12d-b777-4c84-b3fe-8f8b6d4fa8f4 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:13:00.844937 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8bc4e12d-b777-4c84-b3fe-8f8b6d4fa8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:13:00.852812 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1432/2864] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:13:00.864610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:13:00.876835 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786385df-3c81-4ad0-bb87-6656fb588e89 service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:13:00.882030 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2913c0c-3ad0-486e-bb1e-da6f185f24cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:13:00.883407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913c0c-3ad0-486e-bb1e-da6f185f24cd service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:00.883407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913c0c-3ad0-486e-bb1e-da6f185f24cd service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:00.883407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2913c0c-3ad0-486e-bb1e-da6f185f24cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:00.891520 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2913c0c-3ad0-486e-bb1e-da6f185f24cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:13:00.893134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2913c0c-3ad0-486e-bb1e-da6f185f24cd service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:13:00.902129 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1433/2865] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:13:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:13:01.398215 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3498d09-ba08-4e5c-b6f4-3ada34029b24 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:01.398512 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3498d09-ba08-4e5c-b6f4-3ada34029b24 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:01.398799 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3498d09-ba08-4e5c-b6f4-3ada34029b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:01.416897 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c3498d09-ba08-4e5c-b6f4-3ada34029b24 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:13:01.418126 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c3498d09-ba08-4e5c-b6f4-3ada34029b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:13:01.425188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1433/2866] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 8 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:13:01.437603 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2913c0c-3ad0-486e-bb1e-da6f185f24cd service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:13:01.449864 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2913c0c-3ad0-486e-bb1e-da6f185f24cd service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:13:01.454860 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5a3b-799e-4b22-b5f9-54cdfbf565a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:13:01.455508 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5a3b-799e-4b22-b5f9-54cdfbf565a7 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:01.455798 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5a3b-799e-4b22-b5f9-54cdfbf565a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:01.456083 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5a3b-799e-4b22-b5f9-54cdfbf565a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:01.465059 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5a3b-799e-4b22-b5f9-54cdfbf565a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:13:01.466727 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5a3b-799e-4b22-b5f9-54cdfbf565a7 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:13:01.475501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1434/2867] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:13:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:13:01.675077 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f296a-52a9-4e0a-a626-baa8c8b0ec6c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:01.675375 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f296a-52a9-4e0a-a626-baa8c8b0ec6c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:01.675771 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f296a-52a9-4e0a-a626-baa8c8b0ec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:01.693667 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-825f296a-52a9-4e0a-a626-baa8c8b0ec6c None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:13:01.694869 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-825f296a-52a9-4e0a-a626-baa8c8b0ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:13:01.702379 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1434/2868] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 8 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:13:01.714466 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5a3b-799e-4b22-b5f9-54cdfbf565a7 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:13:01.726238 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5a3b-799e-4b22-b5f9-54cdfbf565a7 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:13:01.731407 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72928b-3a1e-4939-bb0c-4552426523d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:13:01.732054 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72928b-3a1e-4939-bb0c-4552426523d4 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:01.732345 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72928b-3a1e-4939-bb0c-4552426523d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:01.732630 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72928b-3a1e-4939-bb0c-4552426523d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:01.740852 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72928b-3a1e-4939-bb0c-4552426523d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:13:01.742467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72928b-3a1e-4939-bb0c-4552426523d4 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:13:01.750782 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1435/2869] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:13:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:13:02.090723 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc36d18-c603-4791-be10-9d747966be3d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:02.091174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc36d18-c603-4791-be10-9d747966be3d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:02.091267 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc36d18-c603-4791-be10-9d747966be3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:02.109419 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4fc36d18-c603-4791-be10-9d747966be3d None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:13:02.110684 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4fc36d18-c603-4791-be10-9d747966be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:13:02.117982 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1435/2870] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 8 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:13:02.130194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72928b-3a1e-4939-bb0c-4552426523d4 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:13:02.140679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72928b-3a1e-4939-bb0c-4552426523d4 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:13:02.146333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c09377-00ab-454a-92a3-9a502228b9a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:13:02.146973 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c09377-00ab-454a-92a3-9a502228b9a9 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:02.147261 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c09377-00ab-454a-92a3-9a502228b9a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:02.147542 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c09377-00ab-454a-92a3-9a502228b9a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:02.155611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c09377-00ab-454a-92a3-9a502228b9a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:13:02.157190 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c09377-00ab-454a-92a3-9a502228b9a9 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:13:02.165896 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1436/2871] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:13:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:13:03.209983 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc36d18-c603-4791-be10-9d747966be3d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:13:03.221029 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc36d18-c603-4791-be10-9d747966be3d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:13:03.224794 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7d22-1caa-4ab6-9fe0-aefdbbda1f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:13:03.225440 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7d22-1caa-4ab6-9fe0-aefdbbda1f11 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:03.225808 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7d22-1caa-4ab6-9fe0-aefdbbda1f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:03.226089 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7d22-1caa-4ab6-9fe0-aefdbbda1f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:03.228100 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ba9c7d22-1caa-4ab6-9fe0-aefdbbda1f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:13:03.294285 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c7d22-1caa-4ab6-9fe0-aefdbbda1f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:13:03.295720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c7d22-1caa-4ab6-9fe0-aefdbbda1f11 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:13:03.305114 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1436/2872] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:13:04.288836 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c09377-00ab-454a-92a3-9a502228b9a9 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:13:04.357863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c09377-00ab-454a-92a3-9a502228b9a9 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:13:04.362375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:13:04.363256 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:04.363604 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:04.363903 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] PATH_INFO: `/v3/users/b3c2b47268f04261ac7ad2a9a3522d17` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:04.365117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c2b47268f04261ac7ad2a9a3522d17)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:13:04.367050 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:13:04.388665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:13:04.418987 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c2b47268f04261ac7ad2a9a3522d17'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.419752 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c2b47268f04261ac7ad2a9a3522d17'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.428187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c2b47268f04261ac7ad2a9a3522d17'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.441215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c2b47268f04261ac7ad2a9a3522d17'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.448327 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c2b47268f04261ac7ad2a9a3522d17'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.455122 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1437/2873] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:13:04 2022] DELETE /identity/v3/users/b3c2b47268f04261ac7ad2a9a3522d17 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:13:04.459973 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719f85-e38b-4d8f-a7b9-0d2c7a3e32ec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:04.460473 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719f85-e38b-4d8f-a7b9-0d2c7a3e32ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:04.460578 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719f85-e38b-4d8f-a7b9-0d2c7a3e32ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:04.480725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-44719f85-e38b-4d8f-a7b9-0d2c7a3e32ec None None] MFA Rules not processed for user `dad84ac759bb44c09343109fa742afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:13:04.482059 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-44719f85-e38b-4d8f-a7b9-0d2c7a3e32ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:13:04.545509 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1437/2874] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:13:04.556900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:13:04.558380 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:13:04.632014 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166d107-d01a-4875-b91f-2c481f916793 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:13:04.635816 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:13:04.636543 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:04.637078 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:04.637375 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:04.648526 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:13:04.650007 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:13:04.659779 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1438/2875] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:13:04.838263 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719f85-e38b-4d8f-a7b9-0d2c7a3e32ec None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:13:04.839840 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-44719f85-e38b-4d8f-a7b9-0d2c7a3e32ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:13:04.852619 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719f85-e38b-4d8f-a7b9-0d2c7a3e32ec None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:13:04.858644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:13:04.859618 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:13:04.860048 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:13:04.860447 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] PATH_INFO: `/v3/projects/545a71ece3ce4ed3badc82bf4fffd032` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:13:04.861964 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545a71ece3ce4ed3badc82bf4fffd032)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:13:04.870961 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:13:04.928366 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545a71ece3ce4ed3badc82bf4fffd032', 'request_id': 'req-ce6537a4-ee66-49bb-938f-e8b371669d91'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.935508 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545a71ece3ce4ed3badc82bf4fffd032', 'request_id': 'req-ce6537a4-ee66-49bb-938f-e8b371669d91'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.944325 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545a71ece3ce4ed3badc82bf4fffd032', 'request_id': 'req-ce6537a4-ee66-49bb-938f-e8b371669d91'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.946761 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:13:04.958904 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] The token cache is being invalidate because project 545a71ece3ce4ed3badc82bf4fffd032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:13:04.959201 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.959874 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:13:04.961801 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1438/2876] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:13:04 2022] DELETE /identity/v3/projects/545a71ece3ce4ed3badc82bf4fffd032 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:13:14.655353 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=8,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:13:14.956421 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:14:51.271348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:14:51.272858 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:14:51.336091 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc00b0-44b2-406d-bc19-6c978c889158 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:14:51.386052 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83990f7249442a582403e654a2278f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:14:51.386710 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:14:51.387006 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:14:51.387290 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:14:51.389087 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:14:51.449194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:14:51.450680 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:14:51.460163 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1439/2877] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:14:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:14:59.368495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:14:59.370807 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:14:59.431346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6537a4-ee66-49bb-938f-e8b371669d91 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:14:59.436090 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b270f2e-961c-4d63-9c96-921b896eb793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:14:59.436753 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b270f2e-961c-4d63-9c96-921b896eb793 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:14:59.437042 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b270f2e-961c-4d63-9c96-921b896eb793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:14:59.437330 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b270f2e-961c-4d63-9c96-921b896eb793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:14:59.439167 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7b270f2e-961c-4d63-9c96-921b896eb793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:14:59.527943 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b270f2e-961c-4d63-9c96-921b896eb793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:14:59.529382 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b270f2e-961c-4d63-9c96-921b896eb793 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:14:59.549922 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1439/2878] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:14:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:15:00.722810 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:15:00.733264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec80b-fdfd-457e-b95d-684da8b1cbc4 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:15:00.737004 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be5e60-276c-49ad-9bfd-ff2ef46e4967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:15:00.737725 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be5e60-276c-49ad-9bfd-ff2ef46e4967 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:00.738013 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be5e60-276c-49ad-9bfd-ff2ef46e4967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:00.738299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be5e60-276c-49ad-9bfd-ff2ef46e4967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:00.740117 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-30be5e60-276c-49ad-9bfd-ff2ef46e4967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:15:00.754707 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be5e60-276c-49ad-9bfd-ff2ef46e4967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:15:00.756150 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be5e60-276c-49ad-9bfd-ff2ef46e4967 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:15:00.767255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1440/2879] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:15:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:15:03.502820 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806edea-d49b-405e-9b05-2f2f0ecaf501 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:03.503315 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806edea-d49b-405e-9b05-2f2f0ecaf501 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:03.503433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806edea-d49b-405e-9b05-2f2f0ecaf501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:03.520804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5806edea-d49b-405e-9b05-2f2f0ecaf501 None None] MFA Rules not processed for user `64cb61cd1c734fb9abab9fe5860c0eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:15:03.522064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5806edea-d49b-405e-9b05-2f2f0ecaf501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:15:03.529205 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1440/2880] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 8 13:15:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:15:10.762356 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=74 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:15:12.760210 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4095880-af5c-4eb2-abf7-0ce23e11781d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:12.760974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4095880-af5c-4eb2-abf7-0ce23e11781d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:12.760974 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4095880-af5c-4eb2-abf7-0ce23e11781d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:12.762961 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1441/2881] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:15:12.768953 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fccd-027d-42c6-8d23-f315869eab6f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:12.769458 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fccd-027d-42c6-8d23-f315869eab6f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:12.769676 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fccd-027d-42c6-8d23-f315869eab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:12.821717 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-20d9fccd-027d-42c6-8d23-f315869eab6f None None] MFA Rules not processed for user `98d7ac35d0e846af97f3ca345ec2ac09`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:15:12.822992 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-20d9fccd-027d-42c6-8d23-f315869eab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:15:12.829804 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1441/2882] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:15:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:15:12.842726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4095880-af5c-4eb2-abf7-0ce23e11781d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:15:12.844467 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d4095880-af5c-4eb2-abf7-0ce23e11781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:15:12.858551 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4095880-af5c-4eb2-abf7-0ce23e11781d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:15:12.862220 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db247e8-f40a-439b-a525-6742c9ac2d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:15:12.862875 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db247e8-f40a-439b-a525-6742c9ac2d48 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:12.863168 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db247e8-f40a-439b-a525-6742c9ac2d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:12.863488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db247e8-f40a-439b-a525-6742c9ac2d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:12.870938 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db247e8-f40a-439b-a525-6742c9ac2d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:15:12.872785 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db247e8-f40a-439b-a525-6742c9ac2d48 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:15:12.881221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1442/2883] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:15:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:15:12.970710 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34011e-6656-44f0-b2d1-cd11911ba817 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:12.971054 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34011e-6656-44f0-b2d1-cd11911ba817 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:12.971552 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34011e-6656-44f0-b2d1-cd11911ba817 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:12.973164 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1442/2884] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 8 13:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:15:12.979215 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7837d8e-bb89-435f-9df2-b640acbad82a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:12.979516 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7837d8e-bb89-435f-9df2-b640acbad82a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:12.979831 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7837d8e-bb89-435f-9df2-b640acbad82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:13.018709 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a7837d8e-bb89-435f-9df2-b640acbad82a None None] MFA Rules not processed for user `63fe1877e3334a29b3bdfa0ba22174da`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:15:13.019965 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a7837d8e-bb89-435f-9df2-b640acbad82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:15:13.029962 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1443/2885] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 8 13:15:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:15:13.040878 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34011e-6656-44f0-b2d1-cd11911ba817 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:15:13.054989 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34011e-6656-44f0-b2d1-cd11911ba817 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:15:13.061127 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25450787-b8a7-4815-90bc-b8b00b57647b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:15:13.061816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450787-b8a7-4815-90bc-b8b00b57647b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:13.062134 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450787-b8a7-4815-90bc-b8b00b57647b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:13.062418 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450787-b8a7-4815-90bc-b8b00b57647b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:13.073060 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25450787-b8a7-4815-90bc-b8b00b57647b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:15:13.075101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25450787-b8a7-4815-90bc-b8b00b57647b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:15:13.086231 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1443/2886] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:15:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:15:22.888379 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7837d8e-bb89-435f-9df2-b640acbad82a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:15:22.897955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7837d8e-bb89-435f-9df2-b640acbad82a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:15:22.901574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:15:22.902574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:22.902878 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:22.903165 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:22.905008 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:15:22.915025 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:15:22.916462 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:15:22.925940 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1444/2887] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:15:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:15:22.927572 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25450787-b8a7-4815-90bc-b8b00b57647b service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:15:22.937096 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25450787-b8a7-4815-90bc-b8b00b57647b service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:15:22.940856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e749ea9-5fac-4a5e-8e1e-eda3ff78af1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:15:22.941510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e749ea9-5fac-4a5e-8e1e-eda3ff78af1d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:22.941872 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e749ea9-5fac-4a5e-8e1e-eda3ff78af1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:22.942161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e749ea9-5fac-4a5e-8e1e-eda3ff78af1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:22.950284 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e749ea9-5fac-4a5e-8e1e-eda3ff78af1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:15:22.951720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e749ea9-5fac-4a5e-8e1e-eda3ff78af1d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:15:22.960017 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1444/2888] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:15:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:15:25.270130 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:15:25.279679 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ce1d6-c751-4b04-9d05-ea93714770ed service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:15:25.283557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:15:25.284260 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:15:25.284554 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:15:25.284867 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:15:25.286948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:15:25.353187 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:15:25.355420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:15:25.366134 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1445/2889] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:15:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:15:32.956147 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:15:35.360982 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=51 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:16:01.309156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037d12-8dcc-41a3-933f-e3a881594734 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:16:01.309693 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037d12-8dcc-41a3-933f-e3a881594734 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:16:01.309784 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037d12-8dcc-41a3-933f-e3a881594734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:16:01.358221 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4b037d12-8dcc-41a3-933f-e3a881594734 None None] MFA Rules not processed for user `256fd73e1b214911b6a2480d89b36090`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:16:01.359441 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4b037d12-8dcc-41a3-933f-e3a881594734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:16:01.430613 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1445/2890] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 8 13:16:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:16:01.477208 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:16:01.478747 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:16:01.570304 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef11a-349c-4402-a33a-bc96d84aaba3 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:16:01.575546 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f027335-b6a2-4f05-a45b-b52153abb04e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1706af7489064b9f9087b740249630b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:16:01.576211 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f027335-b6a2-4f05-a45b-b52153abb04e service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:16:01.576501 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f027335-b6a2-4f05-a45b-b52153abb04e service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:16:01.576906 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f027335-b6a2-4f05-a45b-b52153abb04e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:16:01.586348 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f027335-b6a2-4f05-a45b-b52153abb04e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:16:01.587941 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f027335-b6a2-4f05-a45b-b52153abb04e service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:16:01.597028 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1446/2891] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 8 13:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:16:05.113361 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037d12-8dcc-41a3-933f-e3a881594734 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:16:05.117149 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4b037d12-8dcc-41a3-933f-e3a881594734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:16:05.206615 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037d12-8dcc-41a3-933f-e3a881594734 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:16:05.211997 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:16:05.212735 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:16:05.213097 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:16:05.213589 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:16:05.215576 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:16:05.230004 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:16:05.231720 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:16:05.244186 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1446/2892] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:16:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:16:08.028562 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f027335-b6a2-4f05-a45b-b52153abb04e service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:16:08.040697 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f027335-b6a2-4f05-a45b-b52153abb04e service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:16:08.046058 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:16:08.046574 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:16:08.046984 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:16:08.047803 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:16:08.049871 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:16:08.063387 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:16:08.065488 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:16:08.079009 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1447/2893] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:16:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:16:08.086485 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:16:08.088427 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:16:08.163516 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e2a08-fb9f-4df1-a2df-17167d526084 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:16:08.168844 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:16:08.169774 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:16:08.170064 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:16:08.170347 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] PATH_INFO: `/v3/users/738bbccf2dbd4f38b02c981d11d45834` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:16:08.171558 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] RBAC: Authorizing `identity:delete_user(user_id=738bbccf2dbd4f38b02c981d11d45834)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:16:08.174396 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:16:08.180682 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:16:08.228885 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738bbccf2dbd4f38b02c981d11d45834'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.229560 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738bbccf2dbd4f38b02c981d11d45834'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.236974 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738bbccf2dbd4f38b02c981d11d45834'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.244156 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738bbccf2dbd4f38b02c981d11d45834'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.244780 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738bbccf2dbd4f38b02c981d11d45834'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.263721 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1447/2894] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:16:08 2022] DELETE /identity/v3/users/738bbccf2dbd4f38b02c981d11d45834 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:16:08.437147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:16:08.450221 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c3e8-90e5-4db9-a92b-23026f675feb service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:16:08.509557 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:16:08.510442 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:16:08.510732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:16:08.511015 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] PATH_INFO: `/v3/projects/700431091a924981bc2615de6497319d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:16:08.512207 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700431091a924981bc2615de6497319d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:16:08.514160 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:16:08.559500 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700431091a924981bc2615de6497319d', 'request_id': 'req-cb379d50-1402-4a1a-b200-8bc46792e753'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.567732 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700431091a924981bc2615de6497319d', 'request_id': 'req-cb379d50-1402-4a1a-b200-8bc46792e753'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.569663 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:16:08.573949 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700431091a924981bc2615de6497319d', 'request_id': 'req-cb379d50-1402-4a1a-b200-8bc46792e753'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.585851 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] The token cache is being invalidate because project 700431091a924981bc2615de6497319d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:16:08.586146 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.586805 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.588374 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1448/2895] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:16:08 2022] DELETE /identity/v3/projects/700431091a924981bc2615de6497319d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:16:08.592477 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:16:08.593934 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:16:08.607360 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d0f5-da0e-48fe-b830-c67d5482eeee admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:16:08.663528 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:16:08.664395 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:16:08.664687 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:16:08.664966 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] PATH_INFO: `/v3/users/78744e49097c47fe9556421949e178e9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:16:08.666174 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78744e49097c47fe9556421949e178e9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:16:08.668093 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:16:08.712166 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78744e49097c47fe9556421949e178e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.712824 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78744e49097c47fe9556421949e178e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.720153 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78744e49097c47fe9556421949e178e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.727340 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78744e49097c47fe9556421949e178e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.727952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78744e49097c47fe9556421949e178e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:08.741996 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:16:08.747472 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1448/2896] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:16:08 2022] DELETE /identity/v3/users/78744e49097c47fe9556421949e178e9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:16:08.919423 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:16:08.920890 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:16:08.934040 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379d50-1402-4a1a-b200-8bc46792e753 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:16:08.994479 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:16:08.995349 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:16:08.995637 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:16:08.995916 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] PATH_INFO: `/v3/projects/935cd374b4b84b66a72fb204904cd570` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:16:08.997104 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935cd374b4b84b66a72fb204904cd570)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:16:08.999316 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:16:09.046642 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935cd374b4b84b66a72fb204904cd570', 'request_id': 'req-1da6f790-93ae-4aca-9daf-456a3f2d1c61'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:09.055333 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935cd374b4b84b66a72fb204904cd570', 'request_id': 'req-1da6f790-93ae-4aca-9daf-456a3f2d1c61'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:09.061427 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935cd374b4b84b66a72fb204904cd570', 'request_id': 'req-1da6f790-93ae-4aca-9daf-456a3f2d1c61'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:09.072745 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] The token cache is being invalidate because project 935cd374b4b84b66a72fb204904cd570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:16:09.073038 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:09.073726 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:16:09.075264 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1449/2897] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:16:08 2022] DELETE /identity/v3/projects/935cd374b4b84b66a72fb204904cd570 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:16:19.069736 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=56,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:05.473433 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:05.474915 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:05.531208 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a970-9677-4ba8-939b-8813355b7bb2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:05.578495 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:05.579141 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:05.579424 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:05.579701 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:05.582177 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:05.638848 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:05.640274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:05.649873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1449/2898] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:17:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:17:10.403806 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:10.405237 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:10.419022 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6f790-93ae-4aca-9daf-456a3f2d1c61 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:10.422674 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:10.423294 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:10.423565 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:10.423850 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:10.426491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:10.489789 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:10.491281 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:10.501194 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1450/2899] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:17:15.646222 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=68 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:16.795879 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:16.797873 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:16.821967 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5047d6-399e-4152-b486-9566d3ee3357 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:16.826798 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:16.828039 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:16.828308 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:16.828582 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] PATH_INFO: `/v3/users/08df539d7191496090dcb9edb0529524` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:16.830268 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08df539d7191496090dcb9edb0529524)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:16.832317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:16.883020 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08df539d7191496090dcb9edb0529524'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:16.883681 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08df539d7191496090dcb9edb0529524'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:16.890531 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08df539d7191496090dcb9edb0529524'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:16.897588 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08df539d7191496090dcb9edb0529524'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:16.898224 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08df539d7191496090dcb9edb0529524'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:16.916333 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1450/2900] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:17:16 2022] DELETE /identity/v3/users/08df539d7191496090dcb9edb0529524 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:17:17.095576 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:17.111929 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f48f3-f693-4c58-affe-318548567072 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:17.182625 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:17.183611 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:17.183901 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:17.184186 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] PATH_INFO: `/v3/projects/39427a7ef2fe4741a554e55840827d24` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:17.185409 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39427a7ef2fe4741a554e55840827d24)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:17.187380 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:17.239341 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39427a7ef2fe4741a554e55840827d24', 'request_id': 'req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.246355 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39427a7ef2fe4741a554e55840827d24', 'request_id': 'req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.253436 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39427a7ef2fe4741a554e55840827d24', 'request_id': 'req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.265213 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] The token cache is being invalidate because project 39427a7ef2fe4741a554e55840827d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:17:17.265438 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.266112 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.267659 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1451/2901] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:17:17 2022] DELETE /identity/v3/projects/39427a7ef2fe4741a554e55840827d24 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:17:17.271906 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:17.273350 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:17.287669 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5376-bfe4-49fa-ba80-c9c8566926b8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:17.343923 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:17.344790 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:17.345070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:17.345352 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] PATH_INFO: `/v3/users/02753b84118f4857988c8ebfe450ceb6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:17.346662 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02753b84118f4857988c8ebfe450ceb6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:17.349645 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:17.395380 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02753b84118f4857988c8ebfe450ceb6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.396179 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02753b84118f4857988c8ebfe450ceb6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.403056 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02753b84118f4857988c8ebfe450ceb6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.411752 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02753b84118f4857988c8ebfe450ceb6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.412405 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02753b84118f4857988c8ebfe450ceb6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.420240 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:17.431608 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1451/2902] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:17:17 2022] DELETE /identity/v3/users/02753b84118f4857988c8ebfe450ceb6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:17:17.605285 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:17.606862 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:17.620222 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d151c13-d3fa-4341-b3ad-d3bb8b0d9a5e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:17.649323 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:17.687683 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:17.688568 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:17.688855 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:17.689137 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] PATH_INFO: `/v3/projects/15d658232ffd40429965f3db9ab2c826` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:17.690389 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d658232ffd40429965f3db9ab2c826)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:17.692328 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:17.738900 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d658232ffd40429965f3db9ab2c826', 'request_id': 'req-b05c958d-b1b3-4c8f-af92-a6bf2d855270'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.746334 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d658232ffd40429965f3db9ab2c826', 'request_id': 'req-b05c958d-b1b3-4c8f-af92-a6bf2d855270'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.751993 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d658232ffd40429965f3db9ab2c826', 'request_id': 'req-b05c958d-b1b3-4c8f-af92-a6bf2d855270'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.763470 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] The token cache is being invalidate because project 15d658232ffd40429965f3db9ab2c826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:17:17.763770 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.764454 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:17.766151 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1452/2903] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:17:17 2022] DELETE /identity/v3/projects/15d658232ffd40429965f3db9ab2c826 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:17:27.430778 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:27.760491 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:30.675070 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:30.676593 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:30.762082 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3b70-85c4-4d79-a3b4-cb89e02505e7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:30.851909 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:30.852581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:30.852877 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:30.853161 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:30.855069 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:30.874101 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:30.875745 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:30.888279 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1452/2904] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:17:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:17:32.861318 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:32.863233 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:32.879485 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c958d-b1b3-4c8f-af92-a6bf2d855270 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:32.885711 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe1877e3334a29b3bdfa0ba22174da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:32.886376 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:32.886665 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:32.886948 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:32.888753 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:32.902610 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:32.904342 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:32.917651 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1453/2905] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:17:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:17:40.884078 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=62 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:41.019510 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:41.022031 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:41.082718 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d800f-dd77-4008-b802-8c9eee463529 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:41.087259 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d7ac35d0e846af97f3ca345ec2ac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:41.087910 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:41.088198 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:41.088480 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:41.090232 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:41.154506 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:41.155952 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:41.165950 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1453/2906] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:17:42.911242 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:47.470693 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:47.472472 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:47.491678 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3ced-9e53-408a-8445-d7bdb5acf143 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:47.496403 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:47.497298 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:47.497712 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:47.497985 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] PATH_INFO: `/v3/users/64cb61cd1c734fb9abab9fe5860c0eac` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:47.499456 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] RBAC: Authorizing `identity:delete_user(user_id=64cb61cd1c734fb9abab9fe5860c0eac)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:47.501408 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:47.559152 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64cb61cd1c734fb9abab9fe5860c0eac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.559809 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64cb61cd1c734fb9abab9fe5860c0eac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.566588 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64cb61cd1c734fb9abab9fe5860c0eac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.578524 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64cb61cd1c734fb9abab9fe5860c0eac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.585912 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64cb61cd1c734fb9abab9fe5860c0eac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.591780 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1454/2907] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:17:47 2022] DELETE /identity/v3/users/64cb61cd1c734fb9abab9fe5860c0eac => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:17:47.768838 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:47.779800 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3ff2f-52c2-4249-92f3-e0bfa7dc5b71 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:47.837404 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:47.838346 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:47.838642 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:47.838930 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] PATH_INFO: `/v3/projects/db42a04096d74e1095f331eb00e8fff9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:47.840118 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] RBAC: Authorizing `identity:delete_project(project_id=db42a04096d74e1095f331eb00e8fff9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:47.842206 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:47.888956 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db42a04096d74e1095f331eb00e8fff9', 'request_id': 'req-fedd5fed-9158-4d6c-bf91-f2839494dfee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.890951 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:47.898274 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db42a04096d74e1095f331eb00e8fff9', 'request_id': 'req-fedd5fed-9158-4d6c-bf91-f2839494dfee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.905581 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db42a04096d74e1095f331eb00e8fff9', 'request_id': 'req-fedd5fed-9158-4d6c-bf91-f2839494dfee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.915990 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] The token cache is being invalidate because project db42a04096d74e1095f331eb00e8fff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:17:47.916281 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.916913 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:47.918489 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1454/2908] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:17:47 2022] DELETE /identity/v3/projects/db42a04096d74e1095f331eb00e8fff9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:17:47.922505 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:47.923952 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:47.937507 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774432c-2e40-4643-8c37-14a496dc26af admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:47.993904 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:47.994706 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:47.994988 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:47.995282 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] PATH_INFO: `/v3/users/0f263cb2ca9b41ccbdc5261f2cf7a4e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:47.996452 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f263cb2ca9b41ccbdc5261f2cf7a4e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:47.998420 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:48.044955 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f263cb2ca9b41ccbdc5261f2cf7a4e7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.045644 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f263cb2ca9b41ccbdc5261f2cf7a4e7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.062161 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f263cb2ca9b41ccbdc5261f2cf7a4e7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.075593 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f263cb2ca9b41ccbdc5261f2cf7a4e7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.077581 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:48.085666 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f263cb2ca9b41ccbdc5261f2cf7a4e7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.091944 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1455/2909] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 8 13:17:47 2022] DELETE /identity/v3/users/0f263cb2ca9b41ccbdc5261f2cf7a4e7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:17:48.265600 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:17:48.267503 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:17:48.280188 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd5fed-9158-4d6c-bf91-f2839494dfee admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:17:48.337065 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad84ac759bb44c09343109fa742afe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b549cbd5077d4178b499b2510c76f517', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:17:48.337991 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:17:48.338276 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:17:48.338555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] PATH_INFO: `/v3/projects/b2a1e2eb48ad46df9e60ddab5b0ba211` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:17:48.339742 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a1e2eb48ad46df9e60ddab5b0ba211)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:17:48.341725 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:17:48.388317 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a1e2eb48ad46df9e60ddab5b0ba211', 'request_id': 'req-ba650fcd-bbec-440b-936d-4d725bee2656'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.394700 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a1e2eb48ad46df9e60ddab5b0ba211', 'request_id': 'req-ba650fcd-bbec-440b-936d-4d725bee2656'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.402981 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a1e2eb48ad46df9e60ddab5b0ba211', 'request_id': 'req-ba650fcd-bbec-440b-936d-4d725bee2656'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.415247 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] The token cache is being invalidate because project b2a1e2eb48ad46df9e60ddab5b0ba211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:17:48.415555 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.416228 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:17:48.417816 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1455/2910] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 8 13:17:48 2022] DELETE /identity/v3/projects/b2a1e2eb48ad46df9e60ddab5b0ba211 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:17:58.088255 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:17:58.411171 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:18:03.262299 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:18:03.263750 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:18:03.334616 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120067b6-a094-4ca1-8dcb-8ae28dcf0440 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:18:03.393991 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503eb64-2aaf-4e51-bca1-6293e2c24842 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:18:03.394572 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503eb64-2aaf-4e51-bca1-6293e2c24842 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:18:03.394863 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503eb64-2aaf-4e51-bca1-6293e2c24842 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:18:03.395147 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503eb64-2aaf-4e51-bca1-6293e2c24842 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:18:03.397708 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2503eb64-2aaf-4e51-bca1-6293e2c24842 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:18:03.409975 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503eb64-2aaf-4e51-bca1-6293e2c24842 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:18:03.411796 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503eb64-2aaf-4e51-bca1-6293e2c24842 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:18:03.422813 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1456/2911] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:18:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:18:13.418109 dv-cinder-836996-32-iscsi devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=58 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:23:08.274569 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:23:08.276008 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:23:08.361901 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba650fcd-bbec-440b-936d-4d725bee2656 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:23:08.367109 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db81b53-e029-4851-a3e5-1adac4992630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bc294afca749e5bc2d44c65ea7f96b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a7c05667c74db9a7d7a8310d11fc9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:23:08.367764 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81b53-e029-4851-a3e5-1adac4992630 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:23:08.368055 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81b53-e029-4851-a3e5-1adac4992630 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:23:08.368339 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81b53-e029-4851-a3e5-1adac4992630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:23:08.377238 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db81b53-e029-4851-a3e5-1adac4992630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:23:08.378856 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db81b53-e029-4851-a3e5-1adac4992630 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:23:08.388644 dv-cinder-836996-32-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1456/2912] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 8 13:23:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)